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SEARCH  AND  INFORMATION  THEORY 


A.  0.  Koopcnn 


1 .  Introduc  t  Ion 

Ever  since  the  cid-ninotcen-fortics  when  tnc  theories  of  inforcation 
and  of  search  becace  subjects  o;  general  interest,  attempts  have  been  cade 
to  apply  the  theory  of  inforcation  to  problccs  of  search.  These  have  proved 
disappointing;  neither  the  forculas  nor  the  concepts  of  the  forcer  theory 
nave  found  a  place  in  clarifying  the  problccs  of  tho  latter.  It  has  sccced 
to  the  present  author  that  this  fact  is  a  natural  consequence  of  a  funda- 
ccntal  difference  in  the  subject-cotter  of  the  two  theories:  in  search, 
the  geocetry  (in  the  sense  of  positions,  distance,  areas,  etc.)  is  an  es¬ 
sential  factor  of  the  operat ion-- in  the  elcccntary  act  of  detection  is  to 
select  a  position  and  look  near  it.  In  the  classical  theory  of  Inforcation, 
on  the  other  hand,  no  attention  is  paid  to  such  cotric  cattcrs,  the  ideas 
being  confined  to  dlchotocies:  the  elcccntary  act  la  to  ascertain  in 
which  of  two  subsets  of  a  given  set  (c.g.,  of  states  of  a  systcc)  the  actual 
object  (or  state)  belongs;  and  the  gcocotrlcal  shape  or  extent  of  tho  sub¬ 
sets  has  no  necessary  connection  with  the  operation. 

Tho  purpose  of  tho  present  investigation  lo  to  turn  tho  question 
around ,  and  to  seek,  not  what  applications  inforcation  theory  has  to  ocarch, 
but  what  light  search  can  throw  on  a  broadened  conception  of  inforcation 
theory.  Tho  key  idea  lo  to  start  with  tho  notion  of  tho  elcccntary 
detecting  operation  and  then  to  see  what  kind  of  quantitative  ocaoure  of 
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Regarding  the  second--the  conditional  probability  of  detecting — it 
will  be  assumed  that  there  is  an  elcr.er.tary  uctec t ing  operation,  repetitive 
in  nature,  and  capable  of  answering  certain  of  the  searcher's  questions 
concerning  the  target's  position.  This  operation  nay  only  succeed  with  a 
certain  (known)  probability  of  giving  the  answer;  but  when  it  docs,  It  is 
truthfu. :  w«  arc  not  considering  the  possibility  of  false  contacts. 

Concerning  the  elementary  detecting  operations,  we  set  up  a  schema 
i  of  these  operations  in  such  a  way  that,  by  carrying  them  out  in  a  suc¬ 
cession  depending  on  the  results  as  they  develop,  the  target's  position  is 
finally  f ound--o i thcr  exactly  or  within  a  pro- stated  degree  of  accuracy. 

The  maximum  number  of  operations  needed  may  be  finite,  an  when  X  has  but  n 


positions  and  the  elementary  operation  consists  in  asking  whether  the  target 

is  in  seme  subset  A  of  X  or  not — the  question  always  being  answered.  Or  the 

« 

number  of  operations  may  be  one  integer  on  one  occasion  and  another  on  a 


second--every  positive  integer  representing  a  possibility.  But  in  every 
L..:.e  the  schema  determines  a  random  variable  N^.,  the  number  of  detecting 
operations  up  to  target  localization  (with  the  accuracy  stated).  Since 
..  is  non-r.egat  ive,  it  has  an  expected  value  EN^.,  finite  or  not. 

These  notions  will  so  given  concrete  illustration  by  the  examples 
examined  later.  For  the  moment  we  merely  observe  that  each  performance  of 
mo  elementary  detecting  operation  is  thought  of  as  representing  a  liability 
or  cost  expenditure  (in  units  of  money,  time  lost,  degree  of  exposure  to 
danger,  ct^.).  Therefore,  Ell^.  is  a  "had”  quantity  which  we  seek  to  minimize 
by  our  choice  of  Z. 

Against  this  background  we  lay  down  the  following: 

DEFINITION.  The  quantitative  measure  of  uncertainty  li[p]  in  the 
probability  distribution  p  (l.c.,  in  (X,  S,  p))  is  the  minimum  of  EN  — ojr 
its  greatest  lower  bound — for  all  possible  choices  of  schemata  E .  Further , 
vc  do: Inc  the  information  ns  I(p]  -  C  -  U(p)  the  constant  C  being  so  chosen 
that  I ( p j  “  0. 


2 .  Operational  Compatibility 

The  ideas  involved  in  the  target's  probability  distributions  and 
their  combinations  lead  to  no  conceptual  difficulties.  But  those  which 
concern  the  elementary  detecting  operations  and  their  probabilistic  com¬ 
binations  (with  each  other  and  with  the  probability  distributions)  give 

rise  :o  hitherto  unsuspected  difficulties,  which  were  first  brought  into 

2 

ovider.ee  by  J.  M.  Oobbiu. 
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There  .a  in  fact  a  parting  of  the  ways — according  to  whether  the 
element. >ry  detecting  operation  has  a  material  effect  upon  the  situation  it 
is  intended  to  examine,  or  whether  it  merely  increases  the  searcher's 
knowledge  without  altering  anything  else  in  the  world. 

Only  with  the  advent  o:  modern  quantum  mechanics,  in  the  nineteen 
twenties,  has  the  basic  issue  . rvoiveu  here  been  explicitly  identified. 

The  "principle  of  indeterminacy"  (hotter,  "restricted  accuracy")  is  il- 
1  .t:.»ted  by  the  impossibility  o:  experimentally  determining  boc'n  the  position 
.»nd  the  conjugate  momentum  of  an  elementary  particle  beyond  a  limited 
accuracy.  T..u  reason  is  that,  withen  the  framework  of  this  theory,  state¬ 
ments  about  position  and  momentum  can  only  be  statements  about  the  outcomes 
of  pos it  ion  and  momentum  observations,  whose  actual  performance  involves  a 
mutual  interference. 


Rather  slowly  it  is  being  realized  that  this  issue  is  by  no  means 
confined  to  phenomena  at  the  level  of  the  elementary  particles  of  physics. 

An  example  from  biology  and  from  military  search  will  illustrate  what  is 
basically  involved. 

Suppose  that  a  hitherto  unknown  mutant  of  a  laboratory  rat  is  to 
be  examined  for  resistance  to  two  toxins,  A  and  B.  If  X  is  the  length  of 
time  of  survival  after  the  untreated  rat  is  exposed  to  A,  and  if  Y  is  the 
corresponding  quantity  for  B,  it  is  evident  that  X  and  Y  are  defined  by  in¬ 
compatible  operations.  If  large  numbers  of  such  rats  become  available,  one 
could  measure  the  averages  X  and  Y,  and  so,  by  the  law  of  large  numbers, 
evaluate  their  expected  values,  EX  and  EY .  But  the  expected  value  theorem 

E(X  +  Y)  -  EX  +  EY 

would  be  false — not  because  the  laws  of  probability  are  violated,  but  because 
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i\.c  sy i  a  r  Y,  as  a  chance  variable  measured  by  the  class  of  one-rat  ex- 
involves  an  operatinn.il  contradiction.  More  primitively,  if  a 
is  the  si.ii «.  ...ent  "ihe  rat  dies  within  an  hour  of  sole  exposure  to  A"  and  0 
is  tiie  correspond in^  statement  for  B,  we  cannot  apply  the  theorems  of  prob¬ 
ability  to  1..1:  logical  combinations  a3,  a  +  3,  etc. — not  because  probability 
is  wrong,  but  because  a  and  3  are  incompatible  events:  a3  and  a  +  3  are 
meaningless  according  to  the  definition  of  a  ana  of  3  as  one-rat  events. 

11. e  German  use  of  search-receivers  against  rada.  in  World  War  II 
gives  a  second  illustration  of  the  point:  After  a  first  radar  search  without 
result,  .,  second  search  of  the  same  region  has  a  probability  of  success 
affected,  not  only  by  Bayesian  reasoning  based  on  the  negative  result 
of  the  first,  but  by  the  fact  that  tne  hostile  target  may  have  detected 
the  presence  of  the  searcher  and  taken  measures  of  concealment  (e.g., 
submerged,  if  a  submarine):  The  first  act  and  essentially  change 
the  conditions  of  the  second. 

J.  M.  Dobbie's  example  is  the  case  of  search  for  an  object  dropped 

on  a  sandy  beach,  when  a  first  search  may  have  the  physical  effect  of  ac- 

2 

cidentally  covering  it  with  sand. 

Only  with  the  basic  postulate  that  all  the  events  and  random  variables 

3 

considered  together  in  a  probability  system  are  compatible  — i.e.,  definable 

by  non-interfering  physical  acts  of  observation — does  the  situation  exist 

4 

for  which  the  laws  of  probability  are  conventionally  stated. 

Such  compatibility  shall  be  assumed  in  what  follows. 

3 .  Specific  Cases 

The  concepts  of  the  last  two  sections  are  illustrated  by  cases 
falling  into  two  types. 
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In  che  firsc  type,  che  elementary  dececcing  operation  has  a  unit 
probability  of  success.  For  example,  in  the  definite  range  law  of  search, 
ic  is  assumed  chat  the  target  is  detected  if  and  only  if  it  is  within  a 
circle  of  "detection  range  R"  of  the  searcher.  In  case  of  the  effect  of 
target  aspect,  the  circular  region  may  be  replaced  by  one  of  a  different 
shape;  and  similarly  in  non-symmetrical  looking  (e.g.,  anisotropic  array 
gain) . 

In  these  cases,  we  can  say  that  the  class  S  of  subsets  of  X  (ref.^) 
contains  the  circles,  or  their  modifications;  and  that  the  elementary  de¬ 
tecting  operation  is  that  of  seeing  whether  the  target  is  or  is  not  in  one 
of  these  special  members  of  S. 

A  more  flexible  situation  is  that  in  which  any  member  of  S — i.e., 
any  operationally  meaningful  subset  of  X — can  be  selected;  and  then  the 
presence  or  absence  of  the  target  in  it  determined  by  the  detecting  ob¬ 
servation.  We  shall  call  this  the  case  of  unrestricted  dichotomy. 

In  all  these  cases  we  have  defined  the  elementary  operations,  but 
have  not  yet  examined  the  result  of  their  successive  performance,  nor  con¬ 
sidered  the  construction  of  E-schemata  which  will  guide  the  strategy  of  our 
search-to-localization.  It  is  here  that  the  question  of  compatibility  must 
be  faced. 

In  the  case  of  the  definite  range  law,  let  the  first  elementary 
operation  consist  in  placing  the  observer  at  the  point  xq.  The  probability 
of  detecting  the  target  is  the  probability  of  its  being  within  range  R  of 
xq,  i.e.,  the  integral  over  this  circle  of  the  probability  density  p(x). 

But  suppose  the  result  is  negative;  can  we  say  that  on  a  second  performance 
of  the  elementary  operation,  centered  at  another  point  x^the  probability 


of  detect: Lor.  is  found  by  applying  the  same  formula  to  the  probability 
density  P  (x)  obtained  from  p(x)  by  Bayes'  formula?  The  answer  is  in  the 
affirmative  only  if  the  target's  location  is  unaffected  by  the  first  oper¬ 
ation — i.e.,  in  the  case  of  compa tibility  of  all  the  relevant  events. 

A  similar  statement  applies  to  the  other  examples  just  given  of  this 
first  type  of  case — in  particular,  the  case  of  unrestrained  dichotomy.  And 
in  view  of  our  present  assumption  of  compatibility,  Bayes'  formula  will  be 
applied . 

In  the  second  type  of  elementary  detecting  operation,  the  conditional 

probability  of  detecting,  given  the  target  at  the  place  of  observation,  may 

be  less  than  unity.  Here  the  question  of  compatibility  applies  not  only  to 

the  law  of  change  of  the  a  posteriori  probability  distribution,  but  to  the 

conditional  probability  of  success  of  later  detecting  operations.  With  our 

assumptions,  the  former  is  Bayesian  as  stated  before.  The  latter  is  evidently 

given  by  the  survival  probability  formula  for  repeated  independent  trials: 

if  P  is  the  probability  of  detection  of  one  elementary  operation  (given  that 
o 

the  target  is  in  the  place  searched),  1  -  (1  -  PQ)n  is  the  probability  of 

— y  n 

detection  by  n  repetitions.  This  can  be  written  as  1  -  e  where 

p  =  -log(l  -  P  )  >  0.  In  this  form,  n  may  be  regarded  as  the  number  of  units 
o 

of  searching  effort. 

A  more  general  and  important  situation  is  that  in  which  there  is  a 
continuum  of  elementary  detecting  operations,  measured  by  a  parameter  u  which 
expresses  the  intensity  of  search,  or  amount  of  searching  effort,  directed 
at  a  given  reference  point  xq.  LetPQ(u)  be  the  conditional  probability 
of  detecting  the  target,  given  that  it  is  at  xq  and  that  the  effort  u  is 
applied:  i.e.,  make  the  broad  but  still  restrictive  assumption  that  when 

(x  ,  u)  are  given,  the  conditional  detection  probability  is  determined. 
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Ix  u  is  first  applied  and  than  v,  the  probability  of  detection  of 

the  whole  operation  is  Pq(u  +  v).  Now  since  we  are  assuming  compatibility 

of  the  elementary  operations,  we  can  regard  the  latter  as  equivalent  to  the 

conjunction  of  the  two  former  (e.g.,  first  u,  then  v).  And  since  the  target 

is  given  at  the  probabilities  are  independent.  Therefore,  by  elementary 

probability,  the  complementary  probabilities  Qq(u)  c  1  -  Pq(u),  etc., 

satisfy  the  functional  equation  Qq(u  +  v)  =  Qq(u)  Qq(v).  to 

this  the  obvious  fact  that  Q  (u)  decreases  as  u  increases  (the  more  effort, 

o 

the  more  chance  of  detection) ,  we  can  derive  rigorously  the  solution 

-y  u  -y  (x  )u 

P  (u)  =  l~e  0  *=  1  -  e  ° 

o 

5 

where  y  is  positive.  This  is,  of  course,  formula  of  random  search.  It 
cannot  be  too  strongly  emphasized  that  this  derivation  would  be  wrong  without 
the  assumption  of  compatibility. 

The  remainder  of  this  paper  will  apply  the  definition  of  information 
of  y  1  first  to  the  case  of  unrestricted  dichotomy;  second,  to  that  of  ran¬ 
dom  search.  The  former  will  take  us  into  contact  with  classical  information 
theory,  while  the  latter  will  lead  into  a  new  area,  and  throw  light  on  the 
process  of  surveillance. 

4 .  Unrestricted  Dichotomy  in  the  Finite  Case 

We  assume  that  the  set  X  contains  only  the  finite  number  n  of 
possible  positions  and  that  the  elementary  detecting  operation  consists  in 
subdividing  any  subset  of  X  (possibly  =  X)  into  any  two  complementary 
subsets  (X1  =  X^  +  X*)  and  then  finding  which  one  contains  the  target. 


-8- 


If  we  wish  to  repeat  this  process  until  the  position  of  the  target 
is  ascertained,  we  must  first  decide  on  the  decomposition  of  X  into  X^  and 
X0.  If  the  first  operation  gives  that  the  target  is  in  X^,  we  must  then 
decide  how  to  divide  X^  in  two.  Similarly,  if  the  target  is  given  in  X^. 
This  process  must  be  repeat  d  until  the  target  is  found.  Nothing  prevents 
our  making  all  possible  choices  of  dichotomies  in  advance.  Thus  we  are  led 
to  the  schema  X,  consisting  of  a  complete  system  of  branching  dichotomies, 
as  follows  (using  +  to  denote  the  set  sum  of  two  mutually  exclusive  sets, 
and  "order"  to  mean  the  number  of  subdivision-and-question  procedures): 


First  order: 


Second  order: 


Third  order: 


X  -  xx  +  x2 

XI  =  X11  +  X12  ’  X2  “  X21  +  X22 

X11  =  Xlll  +  X112’"’X22  =  X221  +  X222 


In  writing  this  out  it  is  understood  that  in  a  given  horizontal  line,  we 
stop  a  dichotomy  of  any  subset  containing  just  one  element;  and  on  the  other 
hand,  we  always  push  the  dichotomization  until  this  is  the  case  for  every 
subset.  The  result  is  a  schema  X  appropriate  to  the  present  problem.  It 
can  be  represented  graphically  as  a  "tree",  always  branching  in  two,  with 
branches  finally  terminating  in  points,  n  in  all,  corresponding  with  the 
number  of  positions  in  the  searched  set  X. 


Fig. 

Let  us  think  of  the  terminations  and  the  branch-points  of  the  tree 
as  grouped  into  fixed  levels  corresponding  to  the  orders  of  the  dichotomies 
they  represent,  their  heights  i  above  ground  being  the  corresponding  number 
of  units  of  length.  Then  i  will  run  from  1  to  h,  the  last  order  of 
dichotomy — the  "height  of  the  tree"  (=  0  when  there  is  no  dichotomy:  only 
one  p^  =j=  0) .  Finally,  mark  the  terminating  points  with  the  symbols  p^,..., 
for  the  given  probabilities  that  the  target  be  in  the  positions 
»  •  3C  .  Thus  we  obtain  a  graphical  representation,  of  the  type  shown 
in  Fig.  1,  of  a  schema  E.  We  are  interested  in  the  corresponding  expected 
value  ENj.  of  dichotomies  needed  to  reach  the  target. 

It  is  convenient  to  pass  from  this  graphical  representation  to  a 
mechanical  one:  Imagine  the  tree  as  a  weightless  rigid  frame  of  branches, 
to  the  n  terminating  ends  of  which  are  attached  particles  of  masses  p^,..., 
p^,  as  exemplified  in  Fig.  1.  Then  the  formulas  of  elementary  mechanics 
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Hence,  the  optimum  schema,  which  gives  U [ p ]  by  minimizing  EN’^.,  is  the  tree 
of  lowest  center  of  gravity  bearing  the  given  p^,...,pn  in  the  way  described 
above . 

The  operations  of  "branch-interchange"  transform  a  tree  bearing 
p  , . . . , p  into  another  such  tree:  to  characterize  the  tree  of  lowest  center 
of  gravity  we  must  examine  their  effect  on  the  position  of  this  point.  For 
this  purpose,  a  precise  notation  is  useful: 

Consider  the  line  segments  between  the  levels  i-1  and  i:  each  one 
defines  a  branch ,  composed  of  all  the  segments  joined  to  it  above  (directly 
or  indirectly)  and  all  the  terminating  particles  they  bear  (cf,  the  branch 
enclosed  by  the  dotted  line  in  Fig.  1).  At  one  extreme,  the  branch  could 
reduce  to  a  single  line  segment  terminated  by  one  particle.  Every  line 
segment  will  be  identified  by  two  indices  (i,j),  where  i  is  the  height  of 

its  upper  extremity  (i  =  1 . h)  and  j  is  a  second  identifying  index, 

running  from  1  to  n^,  the  number  of  segments  whose  tops  are  at  the  level 
i.  Clearly,  n^  =  1;  while  for  i  **  2,...,h,  we  have  n^  &  2.  The  same 
two  indices  identify  a  branch — the  one  determined  by  the  line  segment  of 
these  indices.  Let  w^  denote  the  weight  of  the  branch  (i,  j);  i.e.,  its 
total  load  of  terminating  particles.  Thus,  in  the  indicated  branch  of  Fig.  1 
we  have  w2  2  =  P2  +  P3‘ 

A  basic  tree  operation  is  the  interchange  of  two  disjoint  branches, 
e.g.,  (i,  j)  and  (i\  j^),  having  no  part  in  common.  This,  of  course, 
includes  the  interchange  of  the  particles  themselves.  The  useful  and  self- 
evident  fact  is  that  for  the  tree  of  lowest  center  of  gravity,  every  such 
interchange  raises  it  or  leaves  its  height  unchanged.  , 


i ihc  branches  u»  j)  and  (i  ,  J4)  are  ai  iho  sarr.e  level  (i.e., 

4  “  i ) ,  iiic  i r  i s*ii c s  c iidSi^c  pi  Uv..uci‘b  Uo  c hiii'tijc  in  Ll»e  center  oi  r a v  1 1 y  •  1 1  ( 

u:i  :i.i .■  oii.o!  :... .u. ,  j  “  j  ■»■  1  (2  .i  >  ,  li.f  interchange  will  ra.se  the  ctnior 

oi  grnv.iv  or  .over  it  ju'ur^i.,;.v  as  w  >  w  •  or  w  <  w  ,  i 

i .  i  -  1 .  j A  i ,  :  i  1 .  J 1 

. . v  i . , e  v* t:  u!  I . . « 4 * »  « nc  1  p  •  e  ,  1  i . e  I  o  *  * o w  •  > ♦  ^  r  w i-  t  a c  L  r»  are  easily 


k'l)  i  ili<  «  «  h  •  <  C  v 


all  the  probabilities  arc  ecual  (p,  “  ...  »  p  -*  \/i\),  the 
—  '  '  i  n 

■pi  schema  J!  is  obtuineu  bv  xir.h  the  ivo  r.on-neg.i t 1  vo  integers  h,  »t 


tor  winC.'i 


,!.  -  1 

t\  **  *. 


then,  ::  a  >  o ,  p...c.ng  k  par  t  ic  1  et»  .it  tin*  level  h  -  1  (in  a  complete  tree 

v.t.,  *  terminations  ,»t  th»i  level);  and  finally,  at  each  oi  the 

-  h  —  1 

-  a  unused  points,  placing  pairs  ui  branches,  to  whose  2(2  -  k)  • 

2  '  -  2k  ■  n  -  k  terminations  are  attached  the  remaining  n  -  k  particles. 

vising  tnis  schema ,  we  obtain 


— [  (h  -  1)  k  +  h(n 
n 
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h  -  * 
n 


ihis  may  be  compared  with  the  dindlc  entropy 


H  -  -l  p,log2p1  -  log2n 
i  i 

oi  the  present  distribution.  We  have 


U  -  H  -  h  -  —  -  iog.n 
n  2 


-  log.,  (n  +  k)  -  -  -  log2n 


,  /  ,  k .  k 

'  l082U  +  n>  ‘  n  • 
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i  c  :v .  i ;  I  t>e  scon  later,  la  non-negative.  Since  0  •  -  <  1 ,  we  have 

n 


: he  a:»v..  ic  tornula 


O  -  H(1  0  ) 

n 


v  her  o  0 


A.  I:  every  probability  In  (p . .  p^)  la  a  positive  integral 

power  ol  ^  ,  i  ecu  a  1  a  the  dladic  antropy  U  “  H.  For  in  this  case  a  tree 

r  i  ■  i 

can  he  constructed  in  an  obvious  manner  so  that  each  probability  j — j 
is  the  —ass  of  a  particle  of  height  i--and  no  branch  interchange  can  lower 
the  resulting  center  of  gravity. 

u.  in  the  -oat  general  caua  of  probability  (p^,...,  ?n) .  we  have 
t  h e  incc,ua.  i  -)  c  M  n  . 

To  prove  this,  let  E  be  any  schema,  optimum  or  not,  and  in  the 
corresponding  tree,  redesignate  the  probabilities  with  two  indices  as  p  , 

where,  if  there  arc  no  particles  of  height  i,  •  0;  if  there  are  s^  such 

particles,  J  is  an  identifying  index  going  from  1  to  s^.  Clearly 

h  8i 

l  <-  Z  i  l 

i  -  1  J  -  1  3 


h 

H  -  -Z 


-E  E  P  log  p 

i  •  1  J  -  1  3  3 


Now  consider  a  second  tree,  of  the  same  branches  as  the  given  one, 

r  ri 

but  whose  particles  at  height  i  have  the  masses  lyj  .  That  this  is  a 

legitimate  distribution,  i.c.,  that  the  sum  of  the  masses  is  always  unity, 

is  shown  by  the  following  mass  counting  process:  each  particle  at  height 

i  <  h  and  mass  —  |  can  be  replaced  by  two  particles  of  masses  I  “I  at 

% 

height  i  +  1  joined  to  the  original  position  by  two  line  segments,  without 
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alter: ng  the  total  mass.  Continuing  in  this  way,  the  tree  is  replaced  by 
one  o:  equal  weight  and  having  all  its  particles  of  aass  at  height  h: 

there  being  2  “  such  particles,  its  total  r.ass  is  unity. 

I:  p*  is  the  aass  of  the  particle  replacing  p  in  the  original 

*  J  J 

tree,  we  have  by  a  fornuia  of  convex  functions  in  information  theory, 


h  si 
-  Z  Z 
i-1  j-1 


(-1) 


h 

-  -L  s^p 
i-1  -1 

This,  coabined  with  the  definition  of  Uandthe  fact  that  H  -  -Ep^logp^  is 
independent  of  any  particular  tree,  leads  to  the  desired  result  U  a  H  . 

Thus,  the  close  relation — but  not  identity — between  the  search- 
theoretic  operational  definition  of  uncertainty  and  information  theory,  and 
the  diadic  entropy  and  its  negative,  the  quantity  of  information,  are  shown. 
One  might  describe  the  situation  by  saying  that  only  exceptionally  can  the 
full  amount  of  classical  information  be  extracted  by  the  dichotomy  searching 
process.  * 
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5.  L'nres  t  r  i  c  t  ed  Dichotomy  in  Continuum 


«nor.  l;.c  set  X  of  possible  positions  x  of  the  target  is  a  curve,  sur¬ 
face,  or  higaor  dime;;:;  ion. .1  cor.tir.uu~.,  on  which  the  given  probability 
density  p(x)  is  essentially  continuous,  the  expected  number  of  dichotomy 
operations  up  to  exact  localization  is,  of  course,  infinite,  und  the  pre¬ 
vious  ideas  need  to  be  mod i f ied — and  indeed  the  practical  problem  of  search 
shows  that  the  difficulties  are  toe  result  of  a  refinement  irrelevant  to 
the  problem.  ror,  once  the  target  has  been  localized  in  a  sufficiently  small 
region,  it  is  as  good  as  found:  after  all,  the  "position  x  of  the  target" 
means  the  position  of  a  reference  point  in  the  target;  and  if  the  latter  is 
is  a  solid,  its  physical  dimensions  will  extend  about  this  reference  point. 

Or  if  our  "target"  is  not  a  solid  but,  e.g.,  a  radiation,  and  we  are 
searching  for  its  "position"  in  a  space  of  such  characteristics  of  radia¬ 
tion  as  frequency,  polarization,  direction,  etc.,  once  these  are  "boxed 
up"  in  a  sufficiently  smal*  region,  the  practical  problem  is  solved. 

If  X  is  a  finite  line  segment  and  if  target  localization  within  a 
small  distance  Ax  is  sufficient,  we  have  but  to  cover  X  by  n  non-overlapping 

segments  (x .  x.)  of  length  Ax,  and  then  to  apply  the  methods  of  §4  to  the 

i—  i. ,  l 

n  probabilities  obtained  by  integrating  p(x)  over  each  of  these  sub-segments. 

In  this  case,  diadic  entropy  becomes  (usi \g  the  law  of  the  mean  for 
integrals,  etc.) 

n  rXi  TXi 

H  -  -I  J  p(x)  dx  •  log2  J  p(x)  dx 

in’  X i-1  *1-1 


n  rx  i 

-Z  J  pM  dx  •  [log2p(xi)  +  log2Ax)  dx 

i=l  xi-l 
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-  -  J  p(x)  log.,p(x)  dx  -  log  'x  +  Z (Ax) 

X  l 

=  1» [ p (x)  ]  -  logoAx  +  Z(Ax) 

W!1,,r »•  Z(.'.x)  denotes  a  quantity  approaching  zero  with  Ax,  and  H [ p ( x )  ]  is 
i:ic  ai.idir  e..;ropy  ot  a  continuous  distribution.  This  means  that  (ne¬ 
glecting  Z ( j )  it  is  not  ii[p(x)]  that  is  the  greatest  lower  bound  of  the 
uncertainty  1 but  tins  quantity  pius  -log2^x»  which  becomes  infinite  as 
Ax  ■*  0-  Via.  re:  ore,  our  search-theoretic  definition  of  uncertainty  requires 
modi! Nation,  since  in  its  previous  form  its  value  will  be  crucially  de¬ 
pendent  on  the  criterion  of  accuracy  Ax. 

In  order  to  secure  a  more  intrinsic  conception  of  "search  uncer¬ 
tainty" — one  less  conditioned  by  the  value  of  Ax — we  may  proceed  as  follows: 

When  Ax  is  given  (in  addition  to  X  and  hence  n)  ,  we  might  reasonably 
think  of  its  "standard  effect"  as  the  uncertainty  in  the  special  case  when 
p(x)  *s  most  unfavorable;  i.e.,  as  the  maximum  expected  number  of  dichotomies, 
when — keeping  Ax,  etc.  fixed — the  results  of  making  all  possible  choices 
of  p(x)  are  compared.  Evident  reasoning  based  on  the  results  A,  B,  C  of 
54  shows  that  the  maximum  in  question  will  occur  when  the  n  intervals  Ax 
are  of  equal  probabilities,  i .  e .  ,  w'aen  p(x)  is  constant;  and  that  then  the 
uncertainty  differs  by  less  then  unity  from  the  value  log^n  =  lc^L  -  log^Ax, 
where  L  is  the  length  of  the  interval  X.  Moreover,  then  as  Ax  -*•  0  (i.e., 
n  -*■  °°) ,  the  minimum  is  asymptotic  to  the  above  expression  (their  ratio  an- 
proaching  unity) . 
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It  is  noted  that,  if  q(x)  is  the  uniform  distribution  over  X,  i.e., 
if  q (x)  =  1/L,  the  above  expression  can  be  written  as  ~G[p,  q]  ,  where 

G[p,  q]  =JX p(x)  1°82  dx  • 

Now  this  G [ p ,  q] ,  which  will  re-appear  later,  is  the  fundamental  two- 
distribution  information  (the  negative  of  the  "cross-entropy")  introduced 

Q 

in  1950  by  a  number  of  authors,  and  representing  intuitively  the  increase 
in  information  concerning  the  position  of  x  in  X,  conferred  by  any  datum 
leading  one  to  replace  the  probabilities  q(x)  by  the  new  ones  p(x).  It  is 
shown  to  be  between  0  and  +»,  equal  to  the  former  If  and  only  if  p(x)  and 
q(x)  represent  the  same  probability  distribution. 

It  is  necessary  to  consider  cases  that,  in  two  respects,  go  beyond 
the  simple  one  just  discussed.  The  first  generalization  maintains  a  one¬ 
dimensional  X,  but  requires  that  the  interval  Ax  of  acceptable  accuracy  be 
different  at  different  positions,  as  when  a  second  type  of  search  will  follow 
the  first  and  will  have  a  power  of  detection  which  varies  with  position. 

For  example,  if  a  definite  range  l&w  is  to  be  used,  its  range  could  vary  with 
varying  visibility  or  background  noise  from  point  to  point.  Let  two  values 


and  x'1  (x ' <:< '  1 )  be  given;  the  degree  of  inaccuracy  of  a  search  giving 
char  Che  carget  x  is  in  the  interval  (x1,  x'1),  which  in  the  previous  case 
was  its  length  Ax  =  x1'  -x',  is  now  a  more  general  function  of  x' ,  x'1; 
i.e.,  F (x '  ,  x"). 

Clearly,  if  x'">x"  is  a  third  point,  it  seems  natural  to  regard 
the  inaccuracies  as  additive;  i.e., 

F (x '  ,  x’  '  ')  =  F (x '  ,  x’  '  )  +  F (x '  '  ,  x"  ')  . 

But  this  means  that,  for  sets  composed  of  adjacent  intervals,  the  inaccuracy 
F  is  an  additive  set  function — obviously  non-negative.  By  a  reasoning  that 
is  as  old  as  the  calculus  (although  re-phrased  in  all  precision  and  generality 
in  the  modern  theory  of  integration)  ,  we  can  at  once  conclude  that  under  all 
conditions  of  physical  interest,  the  limit 

£<x)  -  lim  f(x-  *’> 
x'-*-x  x'-x 

exists,  and  that  F(x',  x'')  is  its  integral  from  x'  to  x'1. 

We  now  make  a  change  of  variable,  setting  y  »  Mx),  where  <Kx)  has 
a  continuous  positive  derivative  <J>'(x).  This  will  transform  the  interval 
(a  I  x  I  b)  into  another  one,  (a  £  y  i  b) .  On  the  other  hand,  since  p(x) 
and  f (x)  are  densities,  the  quantities  p(x)  dx  and  f(x)  dx  are  preserved  in 
value.  Hence  p(x)  and  f (x)  are  replaced,  respectively  by 

p(y)  =  p (d> (x) )  -  p(x)/<t>'(x) 

f (y)  =  £(*(x»  =  f(x)/4>'(x)  . 


1 
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We  next  select  the  particular  change  of  variables  function  cp(x)  so 
that  f(y)  =1  and  a  =  0;  i.e.,  take 

y  —  (J>  (x)  “  JQX  f(x)  dx  . 


This  means  that  since 


r b  - 

j  -  f  i 


-  f (y)  dy  -  J  f(x)  dx  =  F(b,  a)  , 

d  3 


we  obtain,  for  the  length  of  the  interval  (a,  b)  , 


and  further, 


L  -  F(b,  a)  ; 


p  (y)  =  p(x)/f(x) 


But  this  change  of  variables  leads  from  our  general  problem  back  into 
the  earlier  one,  now  applied  to  the  set  Y  of  the  values  of  the  variable  y, 
upon  which  set  X  has  been  mapped.  The  reduced  diadic  entropy  expression 

r  b 

H [ P (y )  ]  -  log  L  =  -J_  p(y)  log  p(y)  dy  -  log  L  . 


This  becomes,  on  substitution,  etc., 


-  [h  ^^y<1og2f^y>  f(x>  dx  ~  log?F(b,  a) 


-  /  p(x)  log2^^-  dx  ,  =  -G[p,  q] 


where  we  have  written 


fD  f  (x)  dx 


Note  that  the  q(x)  as  defined  has  the  properties  of  a  probability  density. 
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The  final  result  is  again  that  the  excess  of  the  expected  number  of 
dichotomies  needed  for  detection  to  the  accuracy  F(x,  x')  over  its  maximum 
value  has  -G[p,  q]  as  a  lower  bound,  asymptotically  as  Ax  -+•  0. 

Our  second  generalization  is  to  the  case  of  a  higher  dimensional  X. 

In  view  of  the  detailed  considerations  of  the  previous  cases,  it  may  be 
permitted  to  treat  this  case  rather  summarily.  We  shall  uppose  that  two 
non-negative  additive  set-functions  P (A)  and  F (A)  are  given;  the  first  is  the 
probability,  before  the  dichotomy  search,  that  the  target  be  in  the  set  A; 
the  second  is  the  degree  of  inaccuracy  of  the  datum  that  the  target  has 
been  ascertained  to  in  A.  By  a  change  of  variables,  X  can  in  practical 
cases  be  mapped  on  a  set  Y  so  that  F(A)  is  replaced  by  the  "Extent"  (length, 
area,  volume,  etc.)  of  A.  When  the  total  value  F(X)  is  finite,  we  may 
"normalize"  F(A)  to  unity,  i.e.,  replace  it  by  the  probability  set-function 


Q(A) 


F  (A) 
F  (X) 


Then  the  greatest  lower  bound  of  the  expected  excess  of  the 
number  of  dichotomies  for  localization  to  F-acc.uracy  (or  Q-accuracy)  over 
its  maximum  is  asymptotic  to  -G[P,  Q]  ,  where 


G[P ,  Q]  =  J'1°g2(|)  *  dp  "  JpOO  1°82^(t)'  dX  » 

in  which  p(x)  and  q(x)  are  the  density  functions  corresponding  to  P(A)  and 
dP 

Q (A) — or,  better,  —  is  the  derivative  of  the  set  function  P  with  respect 
to  Q.  The  final  result  is  the  following,  which  we  state  here  in  terms  of 
the  search-information,  as  defined  in  §1  (The  negative  of  the  uncertainty, 
and  taken  as  non-negative.) 
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The  search  information  in  the  distribution  P,  relative  to  the  ac¬ 
curacy  standard  Q,  is  bounded  below  by  a  quantity  asymptotic,  as  Q(Ax)  -»  Q, 
to  the  general  diadic  information  G[P,  Q]  . 


6 .  The  Case  of  Random  Search 

Search,  in  the  original  Naval  sense  of  the  term,  is  conducted  by  op¬ 
erations  that  do  not  fall  into  the  class  of  the  dichotomy,  but  which  bring 
to  bear  upon  a  certain  locality  a  determined  degree  of  effort.  As  explained 
in  the  second  half  of  53,  when  the  elementary  searching  operation  is  the 
expenditure  of  the  degree  of  effort  u  in  the  locality  of  the  point  x,  and 
when  all  such  efforts  there  are  compatible,  the  conditional  probability  of 
success  is  1  -  e  yU  ,  where  p  may  differ  for  different  points  x.  This  is 
the  law  of  random  search^,  and  will  form  the  basis  for  the  present  ap¬ 
plication  of  the  conception  of  search  information,  i  .emulated  in  51. 

When  X  is  k-dimensional  and  dx  is  a  k-dimensional  element  cf  volume, 
the  intensity  u  =  u(x)  of  search  at  x  must,  when  integrated  over  X,  give 
(with  the  additivity  assumptions  underlying  the  discussion)  the  total 
searching  effort  U  applied  to  the  whole  of  X: 

(6.1)  J*x  u(x)  dx  n  U  . 

The  problem  of  the  optimum  distribution  of  this  given  quantity  of  total 
effort,  when  the  target's  probability  density  p(x)  is  given,  can  be  inter¬ 
preted  as  follows:^ 
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(6.2)  P[U,  p]  =  /x  p(x) [1  -  e"p(x)  u(x)]  dx 

subject:  to  che  equation  (6.1)  as  well  as  to  the  inequality 

(6.3)  u(x)  £  0 

The  solution  is  given  in  the  reference^.  A  point  of  view  of  sequential 

2 

optimization  has  recently  been  developed  by  J.  M.  Dobbie  ,  particularly  in 
cases  in  which  our  assumption  of  compatibility  is  not  made.  Before  going 
further,  we  must  be  more  precise  about  how  the  quantities  are  measured. 

The  total  searching  effort  U  shall  be  measured  in  units  of  k-dimen- 
sronal  "volume  searched"  (area,  if  X  is  a  region  of  the  surface  of  the 
ocean).  Hence,  the  same  will  be  true  of  u(x)  dx,  the  element  of  integration 
in  (6.1);  and  u(x)  will  be  dimensionless  if  and  only  if  the  coordinates  are 
lengths.  But  in  every  case,  a  change  of  variables  of  integration  must 
leave  u(x)  dx  invariant,  and  hence  multiply  u(x)  by  the  Jacobian  of  the 
original  coordinates  of  x  with  respect  to  the  new  coordinates.  Since 
p(x)  (ix  is  both  invariant  and  dimensionless  (being  a  probability),  p(x)  is 
of  dimension  depending  on  that  of  the  coordinates  x  ([L-^],  if  they  are 
lengths),  and  changing  as  u(x)  does  under  changes  of  variables  of  integration. 
Since,  furthermore,  the  integral  in  (6.2)  is  a  probability,  and  hence  di¬ 
mensionless,  the  quantity  y(x)  u(x)  must  also  be  dimensionless;  therefore, 
the  dimensions  of  y(x)  must  be  the  reciprocals  of  those  of  u(x).  Finally, 
since  y(x)  u(x)  must,  by  similar  reasoning  based  on  (6.2),  remain  invariant 
under  a  change  of  variables  of  integration,  such  a  change  must  multiply 
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y(x)  by  chc  reciprocal  of  Che  Jacobian  of  the  old  coordinates  with  respect 
to  the  now:  i.e.,  by  the  Jacobian  of  Che  new  with  respect  to  the  old. 

We  shall  use  these  facts  to  standardize  our  expressions.  Let  us 
introduce  the  new  function 


(6.4) 


$(>:)  =  u(x)  u (x) 


It  is  invariant  under  change  of  variables  of  integration,  and  is  dimension¬ 
less.  In  terms  of  this,  (6.1)  becomes 


Now  make  a  change  of  variables  of  integration,  selecting  the  new  variables, 
x,  so  that  in  the  invariant  expression 


dx  dx  , 
uM  "  u<xT 

the  £(x)  -  1.  In  other  words,  introduce  such  variables  x  thot  the 
Jacobian 


3(x)  _  D  (x"“”  Xk} 
3  (x)  ’  3  (x,  , . .  . ,  5t  ) 


V  (x) 


U (x, , . . . ,  X  )  . 

R 


Such  a  selection  is,  clearly,  always  possible. 

As  a  result,  the  optimization  problem  corresponding  to  (6.1),  (6.2), 
(6.3),  is  replaced  by  the  one  treated  at  the  outset  of  the  reference"’ 
(replacing  $  by  U)  viz.,  of  finding  that  function  $(x),  among  the  class  of 
functions  satisfying 
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which  ;;.ax  i:..i  2  us 

(6.6)  P[U,  ?]  =  p(x)[l  -  e  v(x)]  dx  . 

In  .ill  tha t  follows,  the  notation  and  results  of  that  reference  will  be 
used  implicityly  (log  denoting  the  natural  logarithm). 

We  have  to  consider  the  expected  "number  of  elementary  searching 
operations",  EN  ,  up  to  and  including  detection.  Here,  the  number 
is  evidently  to  be  interpreted  as  the  amount  of  effort,  6  ,  used  up  in 

the  sea rch  up  to  the  moment  of  detection.  To  obtain  its  maximum  expected 
value,  the  schema  1  must  schedule  each  unit  of  effort  optimally  as  a 
sequential  process.  But  it  is  known"*  that  this  is  the  same  thing  as  to 
have  the  total  amount  of  effort  up  to  any  point  optimally  scheduled. 
Henceforth,  the  schema  Z  will  denote  such  an  optimum  scheduling;  and 
(dropping  this  subscript),  0  shall  denote  the  random  variable  defined  as 
the  quantity  of  effort  just  used  up  at  the  moment  when  detection  is  made — 
assuming  optimum  scheduling  throughout.  Thus,  ❖  is  a  chance  variable 
having  a  probability  distribution  of  taking  on  various  values  U. 

With  this  definition,  the  "uncertainty" — the  U[p]  of  §1 — is  given 
by  the  expected  value  formula 

oo 

(6.7)  U[p]  -  E C  =  f  U  d  prob [$  <  U)  . 

JQ 

Using  the  notation  of  the  reference"*  (log  being  the  natural 
logarithm),  we  introduce  the  non-negative  variable  X,  the  family  of  sub¬ 
sets  A  of  X  parameterized  by  X,  defined  as  the  set  of  points  for  which 

A 

p(x)  l  X  : 
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(6.S) 


Ax  =  [x  |  p (x)  l  X]  ; 


and  also  the  k-d imensional  volume  v  *=  v(X)  of  A^  (area,  if  X  is  a  plane): 


(6.9) 


'(A)  ■=  /  dx 


Since  increases  in  content  with  decreasing  X,  coinciding  with  X  when 
A  =  0,  v(A)  increases  monotonically  with  decreasing  A. 


Similarly,  the  probability  that  the  target  be  in  A^  ,  given  by 


(6.10) 


TT (X )  =>  f  p(x)  dx  , 


is  a  function  of  A,  increasing  monotonically  from  0  to  1  as  A  decreases 
from  +  <*»  to  0.  Furthermore,  for  any  value  of  A  for  which  v(A)  has  a 
derivative  V'(A),  n( A)  does  likewise,  and 


(6.11) 


7i '  (A)  »  AV*  (A)  . 


This  is  easily  shown  by  the  elementary  application  of  definitions  and  of  the 
law  of  the  mean.  A  generalization  of  such  a  relation  to  a  jump  relation 
(5ti(A)  =A6v(A)  can  be  made,  but  will  not  be  used  here,  since  almost  always 
in  applications  the  behavior  of  p(x)  is  such  that  (6.11)  applies  at  all 
points.  Finally,  on  setting 


(6.12) 


S (A)  =  /A  logPfo'*'  dx  =  /A  log  p(x)  dx  -  v(A)  logA  , 
\ 


'S  1 


We  recall  that  it  was  shown3  that  S(A)  increases  monotonically  from  0  to 
+  »  as  A  decreases  from  +  do  to  zero,  and  does  so  continuously,  taking  on 
each  intermediate  value  exactly  once.  This  means  that  any  discontinuities 
in  the  two  terms  on  the  right  in  (6.12)  cancel.  * 
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In  these  terms,  we  can  state  the  results  of  reference  for  the 
optimum  searching  scheduling  as  follows: 

For  each  given  total  available  effort  U,  determine  the  unique  X 
satisfying  the  equation: 

(6.13)  S(X)  -  U  . 

On  the  corresponding  set  ,  apply  the  intensity  of  searching  effort 

(6.14)  $(x)  -  log2^-  ; 

On  the  remaining  set,  X  -  A  ,  apply  no  searching  intensity:  <|>(x)  ■  0. 
Thus,  the  maximum  probability  of  detection — i.e.,  the  probability,  when  the 
effort  is  optimally  programmed,  as  described,  is 

(6.15)  P(U)  -  7T  (A)  -  Xv (X )  . 

Clearly,  this  may  also  be  described  as  the  probability  that  the 
total  searching  used  up  at  the  moment  of  detection,  i.e.,  $,  shall  not 
exceed  U: 

P(U)  ■  prob[$>  «  U)  . 

Accordingly,  (6.7)  gives 

(6.16)  U[p]  -  E ♦  -  /Q  U  d[ir(X)  -  Xv(X)]  . 

Here  the  right-hand  expression  must,  in  the  most  general  case,  be  under¬ 
stood  as  a  Stielijes  integral.  But  in  all  practical  applications  (6.11) 

applies  and  we  can  then  reduce  it  to  the  formula 

00 

(6.17)  U[p]  -  f 0  Uv(X)  dx 
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(The  mines  sign  is  absorbed  in  the  reversal  of  order  of  integration  on  the 
interval  0  =  X  <  +  etc.) 


7 .  Application  to  the  Normal  Distribution 

One  of  the  most  common  situations  in  search  is  that  in  which  the 
target's  given  probability  distribution  is  normal  ;  i.e.,  when  (after 
diagonalizing)  , 


(7.1) 


p(x) 


k  (2tt ) 


k/2 


k  (x±  -  &iy 

exp  -  1/2  £  - £ - 

i-1  °i 


Not  only  does  such  a  distribution  occur  when  the  target's  position  can  be 
regarded  as  due  to  the  accumulation  of  a  large  number  of  small  random 
displacements  or  errors  of  navigation  or  observation,  so  that  the  central 
limit  theorem  leads  to  (7.1);  but  in  many  cases  of  much  more  complicated 
probability  density  (uni-modal  or  otherwise),  when  the  probabilities  in  all  but 
certain  places  are  small  enough  to  be  neglected,  while  in  other  places  they 
are  peaked  enough  to  make  normal  law  expressions  acceptable  approximations. 

Let  us  apply  the  formulas  and  methods  of  §6  to  this  case,  taking 
our  axes  at  the  point  (a)  as  origin — i.e.,  replacing  x^  -  a^  by  x^  . 

Then  we  have  for  A  the  k-dimensional  ellipsoidal  region  on  which  p(x)  *  X, 

A 

bounded  by  the  k-dimensional  ellipsoid  of  equation 


(7.2) 


2  2 

^  ,  Xk  .  ,22  2 /0  . k 

— 2  +  •  •  •  +  — j  ■  “logX  ...  0^(2*) 
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The  k-dimensional  volume  of  this  k-ellipsoid  is  found  by  standard  processes 


of  k-dimensional  integration  (changing  variables  to  =  x^/cj^  and  thus 
reducing  to  nyperspherical  integration).  We  obtain 


(7.3) 


v  (X)  =  a ,  . . .  a,  — ~ ^ —  wk  . 

r(|  +  l) 


To  apply  (6.17),  we  have  to  express  U  in  terms  of  X  by  means  of 
(6.13)  and  (6.12).  Using  (7.1),  with  the  w  as  defined  in  (7.2),  we  obtain: 


2  x,Z  *1 

log  p (x)  =  logX  +  | - (l/2)<-^  +...+—)  ; 


whence,  on  transposing  the  first  term  and  integrating  over  , 


S(X)  =  f  [v (X) 


k  k 


“  Oi  •  •  •  0 


(/tQ  w 


kr(|+2)  k+2 


]  . 


w 

2 


/  rvk  k 
•  U'11;  w 


w 


r(|  +  2) 


k  +  1 


v(X) 


This  value  is  substituted  for  U  in  (6.17),  while  the  dX  is  replaced  by  the 
value  obtained  from  the  second  equation  in  (7.2).  On  making  these  sub¬ 
stitutions,  absorbing  a  minus  sign  in  the  process  of  reversing  the  order  of 
the  limits  of  integration  when  the  variable  of  integration  X  is  replaced 
by  w,  and,  finally,  using  elementary  properties  of  the  gamma  function,  we 
obtain  for  the  "uncertainty"  U[p]  in  the  present  probability  distribution: 
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(7.4) 


U [p]  =  2 a,  ...  a.(/l 2tt)k — r— ^ — - 

r(|+D 

=  2v[w  =  /2]  •  —  -  — ' — 

q  + 1) 

In  the  case  of  Che  plane,  k  =  2,  and  our  uncertainty  U[p]  =  4v[w=/2], 
Here  v[w  =  i/2 ]  is  the  area  of  the  ellipse  of  semi-axes  0^/2,  a2^’>  -*-s 

called  the  "localization  area"  in  the  modern  theory  of  surface  search.  It 
is  such  that  the  probability  that  the  target  is  in  it  is  1  -  —  . 

More  generally,  the  search  uncertainty  is  proportional  to  the 
product  of  the  k  standard  deviations,  the  constant  of  proportionality  being 
explicitly  expressed,  through  (7.4),  in  terms  of  the  number  of  dimensions 
in  question. 

The  application  of  the  notion  that  the  search  "information"  is  the 
negative  of  the  uncertainty,  which  was  appropriate  in  the  case  of  dichotomies, 
seems  less  appropriate  in  the  present  case,  since  it  would  be  a  negative 
number,  becoming  negatively  infinite  as  any  of  the  standard  diviations 
increase  without  limit.  Perhaps  a  more  appropriate  rendering  of  the  con¬ 
cept  would  be  the  reciprocal  of  the  uncertainty.  This  would  be  proportional 
to  the  height  of  the  highest  point  of  the  normal  distribution,  a  quantity 
long  used  as  a  measure  of  precision,  in  the  application  to  the  theory  of 
measurement . 
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NOTES 


1.  la  the  technical  language  of  the  modern  theory,  we  have  a  probability 
space  (X,  S,  p) ,  where  S  is  the  class  of  subsets  A  of  X  in  which  it  is 
physically  meaningful  to  say  that  the  target  can  lie  (the  "measurable  sub¬ 
sets")  and  p  (A)  their  probabilities.  Cf.  P.  R.  Halmos  Measure  Theory 

(D.  Van  Nostrand  Co.,  Inc.,  1950)  Chapter  IX. 

2.  Cf.a  forthcoming  paper  by  J.  M.  Dobbie  in  Operations  Research.  Cf . 
also,  J.  M.  Dobbie,  "Search  Theory:  A  Sequential  Approach",  Naval  Research 
Logistics  Quarterly,  10,  (1963),  pp.  331,  332. 

3.  Only  in  quantum  mechanics  has  this  nation  been  systemmatically  ex¬ 
ploited;  there  it  is  connected  with  the  family  of  commuting  observables. 

Cf.  J.  van  Xewmann,  Mathematische  Grundlagen  der  Quantenmechanik  (Springer, 
Berlin,  1932). 

4.  Note  the  precise  wording  of  this  statement.  We  are  not  saying  that  the 
law  of  probability  would  be  wrong  when  applied  to  incompatible  events,  out 
that,  when  precisely  stated,  their  hypotheses  would  not  be  met  in  such 
cases.  Cf.  B.  0.  Koopman,  Quantum  Theory  and  the  Foundations  of  Probability. 
Conference  on  Applied  Mathematics,  Sponsored  by  the  Courant  Institute 

(NYU)  and  ONR,  McGraw-Hill,  Co.,  1955. 

5.  B.  0.  Koopman, "Theory  of  Search  II,  III",  Operations  Research,  Vol.  4, 

No.  5,  October  1956,  p.  519;  and  Vol.  5,  No.  5,  October  1957,  pp.  613-626. 

6.  For  references  and  a  development  of  this  concept,  see,  e.g.,  S. 

Kullback,  Information  Theory  and  Statistics  (N.  Y.,  Wiley,  1959). 
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THE  LOGICAL  BASIS  OF  COMBAT  SIMULATION 
R,  0.  Koopman 

1 . _ X h a  Two  Aspects  of  a  Military  Operation 

The  evaluation  of  planned  weapon  systems  or  of  proposed  tactics 
must  be  baeodf  in  last  analysis,  upon  advantages  foreseen  in  combat:  in 
battles  not  yet  fought.  But  in  the  real  world,  such  events  are  of  a  com- 
pioxity — both  of  kind  and  of  number  of  combining  factors— as  to  obscure  the 
relationships  of  cause  and  effect.  Vet  if  physicists  can  draw  quantitative 
conclusions  regarding  the  properties  of  matter  in  spite  of  the  inconceivable 
complexity  of  its  detailed  molecular  motions,  we  may  hope  to  do  likewise— 
if  we  learn  to  look  in  the  right  direction— in  the  study  of  combat.  The 
present  work  examines  the  various  methods  that  have  bean  used  for  this 
purpose  (analytic  models,  machine  simulation,  Monte  Ca^lo,  etc,)  with  the 
object  of  discovering  their  basic  common  principle. 

On  turning  attention,  not  to  methods  or  models,  but  to  the  military 
actions  themselves,  the  mopt  striking  fact  is  their  bivalence;  their 
character  both  of  an  evolving  physical  system,  and  of  an  unfolding  set  of 
plans,  intentions,  reasoning  and  counter-reasoning  of  the  men  engaged  in 
the  action,  the  commanders.  The  two  aspects  must  be  examined  separately 
before  they  can  be  comprehended  together  in  the  full  military  operation. 
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Moreover,  Lor  the  evaluation  of  weapon  systems  and  tactics,  it  is  the  physical 
behavior  that  is  emphasized.  How  can  this  be  separated  from  the  human  side 
without  mutilating  a  whole  that  is  greater  than  the  sum  of  its  parts  and  so 
losing  the  meaning  of  both  of  them? 

Two  methods  have  been  used  with  some  rational,  basis  for  studying 
the  physical  aspect  of  combat  without  the  complications  of  the  human  one: 
the  method  of  standardized  decisions;  and  the  method  of  min Lmax  of  game 
theory.  They  are  most  clearly  explained  in  the  context  of  the  succeeding 
section.  In  concluding  this  one,  we  merely  remark  that  the  nearest  to  a 
systematic  inechod  for  examining  combat  in  its  mental  or  human  aspect  is — in 
addition  to  the  study  of  history  itself — use  of  the  war  game,  as  carried  out 
in  staff  colleges. 

2.  The  System  and  Its  States 

Basic  to  any  scientific  examination  of  nature  is  the  concept  of  the 
system:  the  set  of  interacting  things  considered.  Ir.  a  military  action,  the 

system  is  the  totality  of  men  and  weapons  involved,  together  with  their 
environment:  the  medium  in  which  the  action  occurs  and  which  effects  its 

course.  And  equally  fundamental  is  the  concept  of  the  set  of  states  that  the 
system  can  be  in,  just  one  at  any  given  time.  Thus,  in  a  duel  between  two 
aircraft,  the  system  is  the  pair  of  aircraft,  their  weapons  and  equipment  and 
personnel,  and  the  air  in  which  they  are  flying,  including  gravitational  and 
electromagnetic  fields.  In  a  submarine  attack  on  a  convoy,  the  system  is  the 
set  of  vessels  involved,  their  men  and  equipment,  and  the  sea  and  air  in  which 
the  action  takes  place.  In  each  case,  the  state  of  the  system  includes  its 
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physical  state:  positions  and  velocities  of  the  units,  condition  of  annameiiLS , 
da ca-ga liier ing  status,  and  all  Lite  meteorological  specifications.  But  how 
far  into  the  mental  state  of  the  commanders  must  one  go  in  defining  i he 
"state"  of  the  system?  This  can  only  be  settled  by  asking  a  second  question, 
that  of  Lhe^eyoJ u t_i on_  of  t_he  state  of  the  system  v/ i  th  Lhe  passage  or  time. 

Classical  physics  has  traditionally  considered  that  the  state  of  a 
system  is  only  adequ.n.ely  described  if,  once  the  state  is  given,  all  later 
states  are  determined:  (liven  any  'wo  similar  systems  in  the  same  initial 
states,  all  ihei.r  later  states  will  be  Lhe  same — provided  that  their  envi¬ 
ronmental  influences  (external  forces)  continue  the  same.  Thus,  in  Newtonian 
mechanics,  the  full  and  exact  knowledge  of  the  positions  and  velocities  of  the 
parts  of  a  material  system  determine  its  whole  future  motion.  But  it  is  only 
in  the  simplest  military  operations  that  such  an  order  of  determinateness 
exists . 

In  far  more  cases,  it  is  not  feasible  so  to  specify  the  state  of  a 
system  chat  its  subsequent  evolution  is  determined.  What  is  far  more  common 
is  to  have  only  s ta ti s t ica 1  dc termina teness :  in  a  large  number  of  similar 
systems  starting  in  the  same  state,  the  same  proportion  will  go  into  any 
given  later  state.  This  is  the  situation  in  statistical  mechanics,  and  in 
the  more  fully  developed  parts  of  operations  research.  It  is  the  most  that: 
one  may  expect  in  combat  operations. 

This  brings  out  the  role  of  the  human  decision-maker  in  the  evolution 
of  the  system:  the  most  obvious  lesson  of  history  and  common  sense  is  that 


under  the  same  conditions  different  commanders  often  make  different  decisions. 


■ . .  .. ;  cm  i-u.i!  this  in  Usui]  is  enough  ;o  rule  out  unv  s  i  r  i  c  t.  so  i  .  i,  i  .-.u , 

wo  li.ivo,  never  Lliu  !  css  ,  to  dak  wiiethei  Jns  nnpreJ  io.  Lab  i  i  j  ty  u;  i.,!.ok  ,  ,i«i 

e>.  enco.. .passed  in  .1  statistical  UeLe  rm  i.n.ii  eness .  In  civ:  conic.-.  . 

present  study,  this  is  a  purely  practical  question;  can  we  s.i\  i  • 

the  system  reaches  such  and  such  a  state,  we  can  specify  sensiuiy  t..o 
p  rob.  il>  i 1 i t i os  that  the  comma:, a  s  wilt  make  the  various  i  o:n.ui''u.  <  o  < 

ii  is  submitted  that  any  sucli  assignment  ot  prole  id  '  i  .  b  ;s  mi 

is  unrealistic  as  a  prediction  ot  no  future,  hut  foaus  t  i  c  ii  it  . ts 

a  conseiisoi:  of  experienced  commanders)  as  leading  to  a  mode]  .-.erviur.  tc 

.liaate  weapon  systems  or  tactics.  Usually  a  detanite  dec  i..»n«n,  *•.»..!.*  .  •  a.u. 
prc'i.ih  i  i  i  t  ics  of  various  decisions,  Is  formulated  for  each  set  o!  <.jrcM,i 
st.UK.es,  i. .  e .  ,  for  each  sta  tc  of  our  system.  To  reach  such  a  cn,.su,..>u:. 
may  involve  an  extensive  discussion  if  several  commanders  dilt-r.  i  i  m-.y 
even  require  listing  two  different  opinions  when  agreement  cannot  he  t niched, 
each  of  which  is  used  on  two  performances  of  the  game— rather  than  a  "toss 
up"  in  a  single  one.  Thus,  the  decision-maker's  contribution  to  the  induter- 
mina reness  is  removed. 

Another  common  method  for  removing  humanly-caused  indet erm Lna t unx* s 
is  to  assume,  first,  that  at  each  stage  of  tire  action,  ’aeh  commando  has  a 
stated  degree  of  knowledge  concerning  the  other,  assumes  that  the  latter  will 
always  try  to  do  him  the  maximum  harm,  arid  then  picks  his  own  course  or 
action  so  as  to  minimize  it.  Tins  is  the  minimax  convention  o!  game  theory. 
When  applied  sequentially,  it  leads  to  differential  games.  Rightly  emp loved, 
it  gives  a  useful  indicator  in  evaluations;  it  can  never  be  relied  on  to 
predict  the  future. 


■) 

i-  Li.  i  s  point,  on,  we  snail  .uMi.iie  ri.ut  the  human  variabi  li  Ly  has 
,jixn  iv.;  oveii ,  and  shall  examine  vti.it  i:u...ajns:  the  statistical  iy  detcirmi uei  e 
cvoiutio.i  oi  Uf.  military  system. 

,‘j ,  Vt.o  basic  SLochastie  J’rooess 

having  reached  lb.  n  wi.it  n  the  phys ic.ii  uvoi.it  i  m  or  the 

:»y  ;•.  i  <..t..  can  be  studied  iu  itself,  i,  is  necessar  /  to  ;  it  tiro  i.intter  ptec  i.se  ly . 

hoc  S  l.e  tin?  system  nailer  consul*. i  t  j un ,  and  le.  X  r.e  trie  set  ui  till  its 

possible:  states,  Lhu  latter  being  denoted  by  such  lower-case  letters  as 

:< '  ,  y  ,  etc.  in  simple  si  tea  Lions- -or  at  ter  simju  ifying  appi  or  itaat  ions  -X 

...ay  ..oatain  only  a  finjfe  number  of  states;  but.  in  general,  the  number  oi.l 

be  infinite,  and  or  a  more  or  less  high  and  complicated  order.  We  shall, 

however,  use.  the  symbol  >'.  to  denote  summation  o«'*.r  all  its  status,  even  in 

r 

tlie  cases  where,  this  may  actually  be  an  integration,  j,,...dx  ,  possibly  of 
a  very  general  nature  (e.g.,  Kadon-Stieltjos ,  etc.). 

Let  two  states  x,  x1  (distinct  or  not)  in  X  be  given,  in  virtue 
of  the  statistical  ile  turminateness ,  there  is  a  definite  probability 
a(x.  t  ;  x1,  i. '  )  (possibly  ■=  0)  that.,  if  the  system  is  in  state  x  at  time  t, 
it  will  be  in  state  x'  at  the  later  time  t'(>t).  This  is  the  pcobabili  t.y 
of  the  transition 

(x,  t)  -  (x'f  t') 

and  will  be  denoted  by  a(x,  t  ;  x",  t.')  .  It  is  evidently  a  conditional, 
probability;  explicitly: 

a  ( t ,  x  ;  t',  x')  ■=  P  [  S  in  state  x '  a£  t 1  |  S  ijv  state  x  at  l]  . 


(- 


i‘A’  i  ueiiL  1  v  ,  i_f_  the  v. lines  of  llin  transit  ion  prob-ib  [  1  it  ics 


i(x,  t  ;  x1,  t 1 )  wore  all  known,  the  nrobabi  .i  it  ics  of  every  once  out _ of  the 

haltjf  won lil  t)i!  known- -and  this  for  iivm. y  assumed  starcin,:  st.iLr 


Thus,  t-ha  whole  problem  of  the  quantitative  study  ol  mil  i  Un  y 
operations  is  that  of  finding  the  transition  probabilities,  from  knowledge., 
that  ean  reasonably  be  obln  inec .  ..e  shall  see  now  alL  the  stanaarJ  anal/  ... 

models,  Monte  Carlo  simulations,  or  • .  ,  fi.c  into  this  scheme.  in  every  case, 
wtuiL  is  obtained  directly,  by  un.iSs  ■. ibiug  into  probabilit ico  tin.  ,/.\yz 
knowledge  of  the  system  and  how  it  is  operated,  are  the  elementary  transition 
probabilities :  those  for  a  short  increment  of  time  At  =  t'  -  t  --or,  more 

exactly,  transition  rates.  Furthermore,  a  recurrence  relationship  is  always 
made  use  of  (too  often  with  insufficient  justification),  by  means  of  which 
the  general  transition  probabilties  can  be  "built-up"  (therefore,  computed) 
from  the  elementary  ones. 

The  system  S  with  its  set  X  of  states  and  their  transition  prob¬ 
abilities  constitute,  in  technical  language,  a  stochastic  process — the 
fundamental  stochastic  process  of  the  military  engagement  in  question.  iue 
computation  of  the  transition  probabilties  reposes  on  cbe  basic  relations  of 
the  theory  of  stochastic  processes,  concerning  which  an  abundant  literature 
ex  Lsts .  * 

Feller,  "An  Introduction  to  Probability  and  Its  Applications",  Vol.  II. 

Wiley,  New  York, 1966. 

Cox  and  Miller,  "The  Theory  of  Stochastic  Processes".  Wiley,  New  York,  V-i'V 

Doob ,  "Stochastic  Processes",  Wiley,  Hew  York,  1953. 

Loeve,  "Probability  Theory",  Van  Nostrand,  1963. 

Hllle ,  "Functional  Analysis  and  Semi-Groups",  American  Mathematical  Social; 

Colloquium  Publications,  Vol.  XXXI. 
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We  shal.  L  give  the  methods  in  outline  (written  in  the  simple 
notation  Y ,  as  explained  abuve(),  But  before  this  can  be  done,  one  basic  issu'-’ 
u i u s t  be  Laced* 

4.  Tiie  Markovian  Assumption 

Suppose  given  three  successive  epochs,  t  <  t1  <  t11  and  two  states, 
x  and  x’1,  and  consider  the  transition 

(x,  i)  *  (x",  t") 

which  has  the  probability  a(x,  L  ;  x",  t")  .  Since  this  transition  occurs 
by  going  through  some  intermediate  state,  say  x1,  at  the  intermediate  time, 
t  ’  ,  i.e.,  since  the  event  (x,  t)  -»  (x",  t1’)  is  the  event  stated  as  follows: 

for  some  x1  of  X:  (x,  t)  -*■  (x1,  t')  and  (x',  t')  ->  (x”,  t") 

we  should  be  able  to  express  the  transition  probability  a(x,  t;  x",  t")  jn 
terms  of  those  of  the  intermediate  transitions,  by  applying  the  laws  of  com¬ 
pound  and  total  probability  to  the  latter.  in  general,  however,  this  does 
not  mean  that  a(x,  t  ;  x",  t")  can  be  expressed  in  terms  of  a(x,  t  ;  x',  t') 
and  a(x',  t';  x",  t"),  but  rather  of  the  former  and  the  more  complicated 
conditional  probability 

a(x,  t  ;  x',  t'  ;  x",  t")  =P[S  _in  x"  a_t  t"  |  S  in.  x '  art  t '  and  S  in_  x  a  t  t  ] 
by  the  formula 

(4.1)  a (x,  t;  x",  l")  =  X  a(x,  t;  x',  t')  a(x,  t;  x',  t';  x",  t") 

^ ' 
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In  actual  mathematical  models  or  machine  simulations,  this  general 
formula  (4.1)  is  never  used,  but  is  replaced  by  the  formula 


(4.2) 

which , 


a (x ,  t;  x", 
as  it  is  applied 


t")  =  I  a(x,  t;  x',  t')  a(x',  t ' ;  x",  t") 
x' 

it  is  tantamount  to  the  assumption  that 


(4.3)  P[S  in  x"  at  t"  |  S  in  x'  at  t'  and  S  in  x  at  t] 

=  P[S  in  x"  at  t"  |  S  in  x'  at  t'] 


This  is  the  Markoff  assumption  and  makes  our  stochastic  process  a  Markoff 
process.  Then  (4.2)  becomes  valid,  and  is  indeed  the  well-known  Ghapman- 
Kolmogorov  equation , dominating  the  theory — and  hence  the  practice — of  the 
basic  stochastic  process  of  the  present  type  of  operation.  While  details 
will  be  given  later  in  concrete  context,  it  may  be  remarked  already  that,  in 
the  case  that  the  number  of  states  in  X  is  finite,  the  right-hand  side  of 
(4.2)  is  a  matrix  product. 

Under  what  conditions  is  the  Markov  assumption  (4.3)  justified?  In 
other  words,  when  does  the  specification  of  the  state  x'  at  t'  give  such 
complete  knowledge  regarding  the  transitions  from  x'  that  any  further  data 
anterior  to  t'  (e.g.,  that  at  t<t'  it  was  in  state  x)  contributes  nothing 
to  the  probabilities  in  question?  In  a  general  way,  we  may  say  that  when 
there  is  a  material  factor  in  the  situation  that  remains  partly  unknown  after 
the  state  x'  at  t'  has  been  specified,  but  concerning  which  we  may  draw  in¬ 
ferences  from  knowledge  of  the  previous  history  of  the  system,  then  the 
Markov  assumption  is  not  justified. 

This  replacement — and  even  the  formulas  themselves — are  too  often  not 
recognized  explicitly  in  simulations,  but  can  be  discovered  as  implicite  sub¬ 
strata  underlying  the  concrete  procedures  of  the  numerical  operations. 


9 


Such  a  failure  of  the  Markov  property  is  commonly  produced  by  the 
attempt  to  simplify  a  treatment  by  an  injudicious  condensation  of  several 
different  states  into  a  single  one.  An  example  would  be  in  sonar  detection, 
when  the  "state"  of  the  system  does  not  sufficiently  specify  the  acoustic 
condition  of  the  water  in  which  it  takes  place:  the  more  detections  are 
made  (i.e.,  the  more  the  transitions  from  states  of  noncontact  to  contact) 
the  more  the  evidence  that  the  acoustic  conditions  are  favorable,  and  hen.' a 
the  greater  the  probability  of  fn-ther  detections.  The  loaded  die  is  .mother 
example-- the  ollener  it  shows  ace,  the  more  the  chance  that  it  will  show 
ace  again:  the  whole  past  influences  probability  predictions  of  the  future. 

Of  course,  when  methods  of  computer  simulation  are  made  in  the  usual 
way  and  hence  depend  for  their  validity  on  the  Markov  property,  but  when 
this  does  nor.  apply,  for  reasons  such  as  those  just  set  forth,  the  numerical 
results,  however  realistic  they  may  appear,  are  without  logical  basis — at 
least  until  they  are  proved  to  give  an  acceptable  degree  of  approximation. 

The  act  of  simplifying  and  still  retaining  the  Markovian  character — as  well 
as  operational  realism— is  an  art  as  well  as  a  science.  Success  is  more  apt 
to  be  achieved  by  limiting  the  objective  of  the  study  to  the  answer  of  a 
precise  question  rather  than  a  diffuse  multitude. 

5.  Transition  Rates 

Having  postulated  that  the  basic  stochastic  process  of  our  operation 
is  Markovian,  we  shall  now  outline  the  theory  and  practical  application  of 
the  methods  for  obtaining  the  operationally  important  transition  probabilities 
(or  the  corresponding  expected  values,  etc.)  from  the  elementary  transition 
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prohah  i  i  i.  L  i  es — those  applying  :.<>  such  short  intervals  or  Lima  .it  -  i  1  -  t 
tool  l ha  '  .rgc  aspects  oi  the  systori  remain  unchanged  except  by  quantities 
oi  the  order  oi  hr  at  most  during  ,',t. 

Any  transition  probability  a(x,  t;  x’,  t1)  has  cet  tain  ui/.vi  ...us 
properties  resulting  from  tlie  fact  that  it  is  a  probability;  thus 

(5.1)  a(x,  i;  x1,  i  ’  A  t;  x',  i: 1 )  =  j  , 

A 

the  second  formula  expressing  the  principle  of  total  probability.  fu  r  •  , 

since;  no  transition  has  anv  probability  of  occurring  in  a  aero  time  inter.'';' 
a(x,  t;  x' ,  t)  =  0  if  x'  /  x  .  by  continuity ,  a  (x ,  t;  x',  t ' )  -►  0  as 

t'  ->  t  (t.'  -  t),  when  x'  '/  x  .  When  X  is  a  finite  set,  wc  can  say  Uhl 
a(x,  t;  x,  t)  =  1,  and  that  a(.\,  t;  x,  t‘)  >  1  as  t'%t.  In  the  general 
case,  we  ‘nave  to  use  the  symbolism  of  the  Dirac  delta  function  £(x'  ••  x) 

(the  Kroneker  delta  in  the  discrete  case),  and  write 

a(x,  t;  x',  t')  ■>  6  (x '  -  x)  as  t  -*  t' 

meaning  that  for  any  continuous  function  f (x) , 

X  f(x)  a(x,  t;  x',  t  ’ )  f  (x*) 

x 

t,a(x,  t;  x',  t')  f(x')  -►  f(x) 

as  t  *  t'  (r'->t)  . 

In  all  the  actual  physical  and  operational  cases,  more  can  be 
assumed;  it  will  aLways  be  true  that,  for  small  t'-t  >  0,  the  two  members 
of  the  preceding  relation  differ  by  quantities  of  the  order  of  t'-t;  and 
in  fact  a  derivative  exists.  The  most  convenient  way  of  writing  this 
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In  this  finite  case,  the  problem  of  finding  the  general  transition 
probabilities  (here,  the  matrix  A(t,  t'))  from  the  more  elementary  transition 
rates  (the  matrix  B(t))  is  the  old  problem  of  solving  a  system  of  first 
order  homogeneous  linear  differential  equations:  for  each  row  of  the  matrix 
A(t,  t')  is,  for  fixed  t  (e.g.,  t  =  0)  a  system  of  functions  satisfying 
the  differential  system  (5. A)',  whose  initial  values  (when  t'  =  t;  e.g., 
l1  =  0)  are  determined  by  (5.2).  The  different  rows  in  A(t,  t')  form  a 
complete  set  of  linearly  independent  solutions.  The  resulting  solutions 
automatically  satisfy  (5.5)';  and  vice  versa,  by  solving  (5.5)'  (looking 
now  at  the  columns  in  A(t,  t'))  we  get  the  solution  of  (5. A)'.  In  the 
finite  case  considered,  these  solutions  are  uniquely  determined  by  the 
differential  equations,  and  because  of  (5.3),  they  automatically  satisfy 
(5.1). 

The  situation  naturally  becomes  far  more  complicated  for  infinite  x,  not 
merely  with  respect  to  the  approximate  numerical  calculation  of  the  solutions, 
but  even  with  regard  to  such  basic  questions  as  existence  and  uniqueness, 
and  the  deduction  of  (5.1)  from  (5.3).  Even  in  the  case  when  X  is  a  discrete 
but  infinite  set,  as  occurs  in  many  waiting  line  problems  and  birth-death 
processes  of  practical  interest,  uniqueness  and  property  (5.1)  may  fail. 

For  further  discussion,  the  references  given  above  should  be  consulted. 

An  essential  simplification  occurs  when  the  general  conditions 
leading  to  the  transitions  remain  the  same  throughout  the  period  of  time 
considered  in  the  whole  action.  Then  the  probability  of  a  transition 


(x,  t) 


(x\  f) 


will  not  depend  on  the  starting  time  t  but  only  on  the  elapsed  time  t'-t, 
so  we  may  write 


(5.7)  a(x,  t;  x' ,  t‘)  =  a(x,  x' ;  t1  -  t) 

We  then  say  that  we  have  a  stationary  transition  Markov  process. 

With  such  a  process,  the  Chapman-Kolmogorov  equation  may  be  written 
in  the  form  (with  tj  =  t '  -t,  t  =  t"  -  t') 

(5.8)  a (x ,  x";  +  t2)  =  Z,a(x,  x';  t.^)  a(x',  x";  t2) 

while  (5.3)  becomes 

a(x,  x';  At)  =  6(x'  -  x)  +  b(x,  x')  At  +  [At], 

These  two  equations  express  the  semi-group  property  of  our  transition 
probabilities  (Cf.  E.  Hille,  l.c.).  Equations  (5.4)  and  (5.5)  may  now  be 
written  (with  t  replacing  t'-t  and  t"  -  t)  as 

(5.9)  a(*>  x",  t)  =  Z , a (x ,  x',  t)  b(x',  x") 

at  X 

(5.10)  ~  a(x,  x";  t)  =  Z,  b(x,  x')  a(x',  x";  t) 

The  matrix  equations  now  become 

=  A  (t)B 

(5 . 10) /  — =  BA  (t) 


(5.9)' 
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A  ( 1 1 )  A(t  )  =  A(tx  -r  t2)  , 

Ci  '.tm'  A ( 0 )  -  I,  the  identical  matrix.  Thus,  the  solution  problem 
; Li.  it  > x  set  of  homogeneous  linear  differential  equations  with  constant 

coefficients,  which  can  always  be  given  in  terms  of  exponentials.  Since 
clearly  A(t)B  —  BA(t)  =  C  for  all  values  of  t,  an  obvious  method  of  so..;: 
i  ,  co  «.!  i  .igonl.iixe  B,  etc. 


i  ■  ,  So  .  1. 1  :  O.I  of  1 1  a  *  S  t  O  C  hS  S  t  X  C  K  C,  L  0  t  3  OHS 

is  . v i i . . ;  passed  the  three  hurdles — the  rational  elimination  of  the 
tn.rr.an  v-s  r  ;  abl  es ,  tr.e  formulation  of  the  stochastic  process,  and  the  GbC..irir, 

1 1  si  nmi'. ion  probability  rates — we  are  left  with  the  practical  problem 

of  v  i  ng  tie  stochastic  equations,  essentially  (5.4),  of  the  last  section. 

It  is  submitted  that  this  is  a  far  easier  problem  than  the  three  former.  Ire 
may  even  say  that  unreasonable  difficulties  encountered  in  its  handling  are 
usually  the  consequence  of  inadequate  formulation  at  the.  earlier  stages. 

The  stochastic  equations  (5.4)  have  the  form  of  the  first  time- 
derivative  of  the  unknown,  equated  to  a  homogeneous  linear  functional  of  the 
latter.  It  is  a  Cauchy  problem,  i.e,,  the  determination  of  a  function  from 
its  initial  values.  When  things  are  r.ot  as  simple  as  in  (5.4)’,  there  :;.u" 
i.e.  conditions  at  the  boundary  or  at  infinity.  In  moat  military  problem.?, 
there  are  states  into  which  transitions  are  irreversible  (destroyed  units 
do  not  come  back  to  life);  and  absorbing  boundaries.  These  do  not  cause  f. 
difficulties.  But  with  infinitely  extended  X,  there  may  be  a  finite  proba^m.  •.  ty 


of  a  rejection  to  infinity  (cf.  the  divergent  birth  processes,  Feller,  I.e.. 


In,.  ;>  ■  vice  versa.  la  such  cases  one  may  introduce  an  „r.  ,.h 

("  I-.  V  b  ,  \>J 

botniu.iry  condition  pr./venting  mak ing  X  bounded.  If  the  solution,  of  the 
lcsiltin;;  ;  l  >  ■!>  i  cm  shows  little  probability  of  crossing  the  hour... ary  ;  hi. 
modified  version  can  be  accepted  as  a  sufficiently  good  approx ir.i.t :  ",  If 
on  the  contrary  there  is  an  appreciable  probability  that  the  state  wtl.i  re. 

the  houndary,  either  the  orJ,.'oal  problem  was  incorrectly  posed,  or _ .n; 

1  t  ant  opera  t i one  1  reality  is  heinr  revealed. 

Assuming  suc.it  mutters  attended  to,  we  list,  the  general  method., 
tit, at  c.tn  be  examined  for  the  solution  of  the  stochastic  equation;'.. 

A •  jh> r r.t.il  M;m i •■~n Lat ions 

These  always  succeed  when  the  equations  are  of  Idle  tor:: 

In  more  general  cases,  the  linearity  of  the  problem  makes  the  r 
r.ethous  of  the  general  theory  of  such  equations  worth  examining: 
such  as  changes  of  variables,  separation  of  va*.  iabi^s,  Green's 
function,  the  method  of  characteristics.  They  all  have  had  ap¬ 
plication  to  certain  special  operational  problems  of  the  present 
type.  Much  information  is  given  in  some  problems  by  the  equili¬ 
brium  solution:  a  function  independent  of  the  time. 

jk _ Infinite  Series 

Again  the  linearity  of  the  problem  makes  the  expansion  in 
series  oi  the  unknown  function  a  simple  enough  process  to  be  vor ■ 
a  try.  For  small  values  of  t,  power  series  in  this  variable  car. 
be  considered;  but  more  often,  expansion  in  a  series  oi  orthogor,,. 
functions  related  to  the  basic  problem  offers  more  promise. 
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jntegiil  transforms,  anti,  in  stationary  transition  cases, 
i  transformation  on  the  time  axis,  come  under  this  class  of 

i  .ct  iiod .  So  also  does  the  metltod  (if  perturbations. 

.  Successive  Approximations 

This  method,  sometimes  called  the  Picard  process,  consists  : - 
■  .viut.’,  in  sequence  by  integration  the  recurrent  relation  obtai 
:• 

‘‘p+1(x.  r-  *  x"»  t:')  =  £<an(*»  x’’  b(x'*  x"> 

•  !. ,  some  choice — largely  arbitrary — of  the  initial  approximate  -• 

•  ,  t;  x',  t')  is  made.  Tiie  other  approximants  a  (x,  t'  x',  t '  ,) 

<.■  n 

it  ■  computed  successively  for  n=l,  2,  ...  Under  very  genera]  coi 
hit  ions,  the  sequence  of  functions  so  obtained  converges  to  the 
desired  solution.  This  method  has  been  used  in  celestial  mechar  :  s 
lor  centuries.  With  the  use  of  modern  computers,  much  of  the  labor 
of  calculation  can  be  avoided. 

D.  The  Approximation  by  Difference  Equations 

The  methods  most  used  at  present  come  under  this  heading. 

There  are.  two  separate  steps  in  the  process: 

(a)  The  replacement  of  continuous  time  t  by  discrete  period 
i.e.,  by  "short"  time  intervals  At,  so  that  the  discrete  success., 
of  epochs 

c0»  tl’  t2’  *■'  ’  Ci  ~  ti-l  = 
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is  used,  b(x,  x' ,  t)  is  replaced  by 

b^(x,  x')  -  b(x,  x‘,  t^)  At  ,  i  =  ti  -  '"i 

and  a (x ,  t ;  x ' ,  t 1 )  by 

a_  (x,  x' )  =  a (x,  ti;  x’  ,  t .)  . 

Finally,  the  stochastic  equation  (5. A)  is  replaced  by  the  ap¬ 
proximate  result  of  integrating  it  over  the  interval  (t  ^ ,  t  ; : 


x") 


s'aj,i-i<x'  x,)  bi(x'-  x"> 


The  fact  that  by  taking  the  time  intervals  At  (which  need  not  ai . 
be  of  the  same  length)  relatively  small,  a  useful  approximation  ■ 
be  obtained,  is  the  practical  basis  of  the  method,  which  replaces 
a  differential  equation  by  a  recurrence  formula.  This  procedure  i.as 
long  been  used  in  celestial  mechanics,  and,  under  the  name  of  Cain.'  , 
Lfpschitz  method,  in  the  theory  of  differential  equations. 

(b)  Another  step  in  the  process  is  taken  when  the  number  of 
states  x  in  X  forms  a  continuum,  so  that  the  stochastic  equations 
are  integro-dif f erential  equations,  the  Y.  in  (5.4)  and  (5.5)  heir:-, 
actually  a  /  .  It  is  often  possible  to  divide  such  a  continuous 
X  into  a  finite  number  of  cells,  small  enough  so  that  the  difference 
in  behavior  of  the  system  at  different  states  in  the  same  cell  c-:j 
be  neglected,  yet  large  enough  so  that  the  total  number  N  of  cel  s 
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covering  X  can  be  handled.  On  labelling  each  of  the  cells  by  a  sub¬ 
script  s  running  from  1  to  N,  and  replacing  the  integration  over  X 

by  the  approximating  summation,  the  transition  probabilities 

s  s ' 

a(x,  t;  x',  t')  become  replaced  by  elements  a'  ’  (t,  t. ' )  in  an  N- 

by-N  matrix,  and  similarly  for  b(x,  x',  t)  which  is  replaced  by 
s  s ' 

b  ’  "  (t).  Then  (5. 'll  and  (5.5)  assume  the  forms  (5.4)'  and  (5 
so  that  the  simple  theory  of  sui.ii  differential  equations  can  he  a.. 

In  particular,  in  the  stationary  transition  case,  they  become  ( 5 . V  ‘ 
and  (5.10)'  and  can  be  solved  explicitly. 

(c)  Both  Processes  (a)  and  (h)  Used  Together.  The  stochastic 
functional  equations  then  take  the  form  of  recurrent  matrix  relar.  or. 
relating  the  transition  matrices 


J  .  i 


t  s ,  s 
i  a .  .  , 


B.  -  li  bS*S  ||  . 

i  1  '  i  ' 


s  s 

Here  a^’^,  is  the  probability  that  if  the  system  is  in  the  state  of 

index  s  at  the  epoch  i  it  be  in  the  state  s'  at  the  epoch  i'  . 
s  s ' 

Similarly,  b  1  is  the  "elementary"  transition  probability  th-  '  ■  t 

the  system  has  the  state  index  s  at  epoch  i— 3 ,  it  be  in  s'  at  the 
next  epoch  i.  The  stochastic  equations  are,  in  matrix  form 


A. 

i, 


=  A 


i.i'-l 


These  are  solved  by  recurrence,  starting  from  the  fact  that  A^ 
the  identical  matrix.  The  solution  is  then 


113  , 
i  i+1 
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When  in  particular  the  process  is  01  st.ai  Li-nary  transi  t  ions,  b.  =  ji 

i 

(independent  of  i)  and  we  have 


t.no  last  expression,  tor  the  case  of  stationary  transitions. 

The  replacement  a£  the  stochasi  i.c  equations  by  difference  equal.:  -> 
a.-  set  forth  above  under  U(c)  ,  is  the  most  directly  adapted  to  machine 
calculation,  since  all  that  lias  to  be  computed  ate  sums  of  products  of  ,<... 
numbers.  The  latter  can  be  given  in  tabular  form,  no  curve-1 i tt ing  to. un¬ 
being  required.  It  is  of  general  and  uniform  applicability,  not  requiring 
special  conditions  or  calling  for  exceptional  insights.  Finally,  it  can  no 
described  and  understood  in  the  terms  of  elementary  mathematics. 

The  method  has,  unfortunately,  one  major  disadvantage:  in  orde- 
to  keep  the  number  N  of  cells,  into  which  the  actual  states  in  X  have  bc-.v. 
condensed, small  enough  not  to  over-run  any  computer,  it  may  be  necessary 
make  the  cells  so  coarse  that  the  transition  probabililie  may  he  quite  a.  - 
ferent  for  two  states  in  the  same  ceils:  then  the  basic  stochastic,  proce.-. 
is  not  even  approximately  Markovian — and  the  wi  i  ole  logical  jus  til  icatioi, 
the  computation  disappears.  Another  way  of  saying  the  same  thing  is  to  - 


..uior  such  conditions,  the  difference  equations  introduced  in  D(c)  are 
r..  t  approximations  to  the  true  stochastic  equations.  Unfortunately,  the  numbers 
is  uing  in  profusion  from  the  computer  cannot  be  expected  to  give  any  warning 
that  the  program  lias  lost  its  logical  basis. 

/  .  Xor. t e  Carlo  Simulations 

In  tiiis  very  commonly  employed  method  of  studying  military  operations, 
uar.a  specifying  the  state  of  affiars  at  any  epoch  of  time  is  programmed  into, 
i.r  produced  by,  the  computer.  A  rule  is  also  programmed,  of  such  a  nature 
that  the  computer,  when  in  a  particular  state  at  a  given  epoch,  automatically 
selects  a  state  into  which  it  goes  in  the  succeeding  epoch.  This  programmed 
selection  rule  may  be  deterministic:  just  one  definite  state  from  the  pre¬ 
ceding  state.  Or  it  may  be  statistical :  by  the  use  of  a  table  of  random 
numbers , (mapped  in  an  appropriate  way  to  correspond  to  a  desired  probability 
distribution,]  the  succeeding  state  is  chosen  at  random,  each  possibility  with 
the  predetermined  probability.  It  is  this  "random  machine"  character  of  the 
operation  that  has  given  it  the  name  of  Monte  Carlo. 

It  should  be  clear  that  the  machine,  when  used  in  this  manner,  is 
i tself  a  physical  system  S;  that  things  have  been  so  arranged  that  it  has  a 
known  set  X  of  states  x;  and  that,  from  epoch  to  epoch,  its  states  change 
according  to  a  known  program  of  transition  probabilities.  Since  at  any  given 
epoch  the  Monte  Carlo  selection  of  the  next  state  is  drawn  from  a  distribution 
that  is  determined  by  the  state  the  system  is  ther.  in,  the  transition  process 
is  Markovian.  Thus,  the  machine  is  made  to  form  a  system  moving  from  state 
to  state  according  to  a  Markov  stochastic  process.  The  fact  that  this  system 
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is  regarded  as  behaving  in  essentially  the  same  way  as  the  actual  military 
operation  has  given  it  the  name  simulation. 

To  assume  that  such  a  use  of  machines  gives  even  approximately  valid 
information  about  the  military  operation  is  to  assume  the  following: 

1.  that  the  human  uncertainties  have  been  removed; 

2.  that  che  combat  situation  involves  a  system  that  is,  at  any 
time,  in  a  objectively  descri.bable  state; 

3.  that  its  state  transitions  are  Markovian; 

4.  that  its  stochastic  equations  can  be  satisfactorily  approximated 
by  difference  equations,  as  in  D(c),  without  losing  their 
Markovian  character; 

5.  that  the  repetition  of  runs  gives,  by  the  law  of  large  numbers, 
satisfactorily  accurate  and  reliable  values  of  the  desired 
probabilities . 

Inasmuch  as  these  are  precisely  the  matters  examined  in  succession 
in  the  preceding  sections  of  the  present  paper,  it  can  be  said  that  the  logical 
bases  of  Monte  Carlo  simulation  have  been  laid — that  it  depends  for  its 
validity  on  the  reasoning  we  have  been  giving. 

The  question  of  the  cost-effectiveness  of  its  use  of  machine  time, 
as  compared  with  the  use  of  machines  for  the  direct  multiplication  of  matrices, 
as  described  at  the  end  of  the  preceding  section,  is  a  question  that  is  too 
infrequently  raised.  In  some  recent  Naval  studies  the  author  has  found  that 
the  direct  computation  of  matrix  products  has  had  far  greater  cost-effectiveness. 

The  method  of  Monte  Carlo  simulation  has  one  particular  value:  its 
educative  or  intuition  building  effect  on  those  who  behold  the  actual 
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;  ,<r;.  ..;.oe  uf  Li..;  pror.-ss .  It  aj  lows  die  results  of  experimental  variations 

,  a  !  at' tors  of  die  situation  to  be  perceived  in  a  direct  and  life-ljke 
.ray.  appearance  of  realism  is  so  great,  that  it  has  often  led  observers 

to  lorgei.  that  Lltev  were  not  in  fact  observing  Nature  directly:  a  disastrous 
i  rror . 

a.  ;'ii  ns  Through  the  Slates 

bp  to  iwv  it  ho s  been  tacitly  .assumed  that  the  set.  X  of  states  x 
(or  its  c oar soi  finite  approximation)  could  be  described  individually,  so  teat 
-.:e  ti ansi  lion  races  or  elementary  transition  probabilities  could  be  listed, 
and  the  stock., si Lc  ecua lions — however  hard  they  might  be  to  solve — actually 
•.•ric ten  down.  There  are  enough  examples  of  this  situation  to  lead  to  such  •> 
view.  Mor.u  ver,  it.  is  the  typical  case  in  classical  mathematical  physics. 

A  few  simple  problems  may  force  a  somewhat  brutal  change  in  such  an 
optimistic  position. 

Consider  the  combat  model  of  Lanchester,  in  which,  at  each  time  t, 

there  are  two  forces  in  opposition,  u  units  on  one  side  and  v  on  the  other, 

the  rate  of  destruction  of  either  being  proportional  to  the  number  in  the 

other.  The.  system  S  consists  of  the  two  forces.  Each  state  is  characterized 

by  the  pair  of  numbers  (u,  v) .  If  at  the  starL  u  =  u^  and  v  =  v  ,  the  number 

of  states  would  be  u  v  .  For  values  even  as  moderate  as  u  =  v  =  10,  this 

oo  oo 

2 

number  would  be  100  and  the  transition  matrix  would  have  100  =  10,000  elements. 

In  die  present  case,  however,  there  are  two  simplifying  factors  in  the  situation, 
which  are  typical  of  many  cases  in  whicli  the  direct  enumerative  treatment  im¬ 
plied  in  the  preceding  sections  is  impracticable,  but  in  which  the  solution 
can  never theless  be  given. 
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The  first  simplifying  i actor  in  the  Lanchester  model  is  the  circum¬ 
stance  that  only  a  smaLl  number  u!  transition  rates  differ  from  zero.  ' n  a 

short  time  At,  u  can  go  only  into  itself  (probability:  1-bvAt)  or  into  u  -  1 
b  i  in  i  rly  V. 

i probab i i i t y :  bvAt)^  All  other  transition  probabilities  are  zero.  (Ail 
these  statements  neglect  terms  of  higher  order  in  At).  Lanchester  was  led  by 
this  fact  to  use  —  instead  of  i hi-  stochastic  model — a  deterministic  one,  in 
whuh  (u,  v)  are  regarded  as  continuous  variables  having  time  derivatives 
given  by  ris  weli-Wnown  equations 


id.  ! ) 


ou 

dt 


-bv  , 


dv 

—  =-au 
dt 


here  ana  b  are  the  "coefficients  of  effectiveness"  of  the  first  and  second 
:orces.  Vms  has  the  effect  of  making  ail  the  states  into  which  the  system 
i,  ..t.utmg  from  (u^,  v  )  ,  determined  by  these  initial  values  and  the 

e Lapsed  time  t,  because  of  the  uniqueness  of  the  solution  of  the  differential 
equations  (8.1).  Thus,  the  problem  has  the  form  of  problems  of  classical 
mechanics . 

When,  to  a  good  approximation,  the  transition  function  a(x,  t;  x' „  t 
determines  the  state  into  which  the  transition  can  occur,  we  say  that  the 
system  traces  out  a  path  in  its  space  of  states  X.  When  this  is  true  except 
at  a  "small"  number  of  states — noda.L  states — which  allow  a  "small"  number  cf 
different  states  to  be  entered,  we  say  that  we  have  a  graph  of  paths.  When 
certain  of  the  paths  never  have  any  further  modal  points,  they  are  called 
brandies ■  There  may  be  cycles,  i.e.,  paths  returning  to  their  original  state 
When  the  graph  of  paths  has  no  cycles,  it  is  called  (according  to  the  usage 
in  Topology)  a  tree . 
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Thus,  the  reuuc Lion  of  a  combat:  model  to  a  graph  of  paths,  with 
probabilities  entering  only  at  the  (exceptional)  nodal  states,  greatly  reduces 
tiie  .stochastic  complexity  of  combat  models. 

How  would  this  simplifying  circumstance  show  itself  within  the  general 

. . : i a 1 y  t  i c  framework  we  have  been  using?  The  simplest  answer  is  in  the  case  of 

finite  X,  when  our  transiti-:  quantities  are  matrices:  Then,  except  at  the 

v-wjuains  of  transitions  out  of  nodal  states,  each  row  in  every  transition 

:•  .1  tix  has  al.i  hut  one  element  zero,  the  exceptional  element  being  unity.  ir. 

tne  continuous  case,  the  i  emulation  would  involve  the  Dirac  delta  function, 

I  it  this  point,  the  usefulness  of  attaching  the  special  case  to  the  gene  mi 

lumuiat  ion  is  largely  lost:  it  is  easier  and  more  natural  to  derive  it  :m 

>'c 

Ll.e  simpler  deterministic  symbolism  in  the  first  place. 

We  she,.)  see  !n  $ '  s  9-1.1  how  the  concepts  of  the  graph  of  paths  arc 

the  endgame  (usually,  duel )  bring  the  quantitative  study  of  even  quite  large- 
scale  military  actions  into  the  realm  of  practicable  quantitative  treatment.. 

The  second  simplifying  factor  in  the  Lanchester  model  is  the  pos¬ 
sibility  of  expressing  the  vast  number  of  transition  rates  by  a  simple  math¬ 
ematical  law — thus  avoiding  the  need  of  their  individual  case-by-cast  enumeration. 
The  habit  of  individual  enumeration  is  easily  developed  through  association  with 
modern  computers,  that  are  so  capable  of  having  each  special  piece  of  numerical 
datum  programmed  into  them — whether  formulas  are  available  or  not.  In  experience 

This  could  be  illustrated  by  Hamiltonian  dynamics,  in  which  the  state  x, 

(position  and  momentum)  is  a  point  in  phase-space  X,  determined  by  its 
initial  value  xQ:  xc  =  f(t,  xQ) .  Ergodic  and  kinetic  theory  make  use  of 
the  probability  distribution  over  X  at  t,  p(t,  x) .  This  evoli  as  with  increase 
of  t  according  to  the  simple  equation  p(t,  x)  =  p(0,  f(-t,  x))  (in  the  steady 
case).  This  is  actually  a  transition  probability  (density):  p(t,  x)  =  a (x0, 

0;  x,  t).  Yet  it  would  be  highly  awkward  and  artificial  to  write  it  in  the 
form 


p(t,  x)  =  p(0,  xq)  6 (x  -  f(t,  xq))  .  t 


v . 
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confined  to  manageable  numbers  of  inputs,  the  power  and  flexibility  of  this 

method  recommend  it.  But  if  we  have  to  do  this  in  well  over  10,000  cases, 

it  would  cease  to  be  a  practicable  operation. 

In  the  present  example,  let  us  write  the  stochastic  equations  for  the 

transition  matrix  a(x,  t;  x1,  t1) — or,  because  of  the  steady-transition 

property,  a(x,  t’,  t'-t) — as  f(t,  u,  v) :  the  probability  that  at  t  the  first 

and  second  forces  have  u  and  v  units  respectively,  given  that  at  t  =  0  they 

had  u  and  v  .  To  terms  of  higher  order  in  At,  we  have,  for  small  At>0, 
o  o 


f(t  +  At,  u,  v)  =  (1  -  bvAt  -  auAt)  f(t,  u,  v) 

+  bvAtf(t,  u  +  1,  v)  +  auAtf(t,  u,  v  +  1) 


when  u  >  0,  v  >  0; 


f (c  +  At,  0,  v)  -  f(t,  0,  v)  +  bvAtf (t ,  1,  v)  . 


H(,  Al,  u,  0)  -  f(i,  u,  v)  auAtf(t,  u,  1)  . 
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These  are  the  equations  of  the  Lanchester  stochastic  process, 
introduced  and  studied  after  Lanchester' s  time  by  a  number  of  authors  during 
the  last  quarter  century  (cf.,  e.g.,  Morse  &  Kimball /'Methods  of  Operations 
Research', '  M.I.T.  Press,  Cambridge,  Mass.  (1951).  R.H.  Brown,  "The  Theory  of 
Combat:  The  Probability  of  Winning,"  The  Jor.  of  the  Op.  R.  Soc.  of  America, 
Vol.  11  (1963)  pp.  418-425).  By  making  use  of  the  simple  mathematical  law 
of  transitions,  they  remove  all  the  complexity  of  individual  enumeration 
and  reduce  the  problem  to  the  form  of  classical  analysis. 

There  are  two  ways  of  setting  forth  the  connection  between  these 
stochastic  equations  and  the  deterministic  ones,  (8.1).  The  first  recognizes 
that  in  the  former,  u  and  v  are  random  variables,  while  in  the  latter,  these 
symbols  denote  expected  values  (u,  v) : 

(8.5)  u  °  Z  f(t,  u,  v)  u  ,  v  =  Z  f(t,  u,  v)  v  . 

u,v  u,v 

Let  (8.2)  be  summed  for  u  fixed  but  v  going  from  1  to  vq,  and  the  result 
added  to  (8.4),  We  obtain,  since  elementary  calculation  shows  that 

vo 

f(t,  u,  1)  +  A^(t,  u,  v)  -  f(t,  u,  vq  f  1)  -  0  , 

the  result 

v 
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f  of  (3.6)  is  Che  function  of  them  chosen  to  fit  the  initial  conditions: 

to  reduce  to  a  given  function  f  (u,  v)  when  t  =  0.  In  the  usual  case, 

o 

f  (u,  v)  =  6.(u  -  u)6(v-v).  We  will  illustrate  this  by  finding  the 

O  0  0 

curves  in  the  (u,  v)-plane  into  which  the  paths  (in  (u,  v,  t)  -space)  project. 
We  have  but  to  find  the  time-independent  integral;  i.e.,  to  integrate  the 
last  equation.  It  gives  at  once 

2.2  2,2 
au  -  bv  =  au  -  bv  , 
o  o 

i.e.,  n  family  of  hyperbolas,  which  are  the  level  surfaces  of  any  time- 
independent  solutions  of  (8.6):  these  are  the  geometric  paths,  traced  out 
by  our  system  with  passage  of  time. 

It  must  be  emphasized  in  conclusion  that  the  deterministic  path 
equation.?  (o.l;  arc  only  au  approximate  rendering  of  the  stochastic  equation 
of  the  Lunches  ter  process  (8.2)  -  (8.4),  acceptable  only  under  special  con¬ 
ditions.  The  fact  that  such  graph-of-paths  simplifications  are  possible, 
as  well  as  the  fact  that  they  are  never  more  than  approximate,  are  typical  of 
a  host  of  operational  problems  of  this  category. 


9_. _ Patterns  of  Flow 

The  points  made  in  the  last  secion,  and  others  ns  well,  arc  il- 
.i.  trued  by  a  particular  operation  that  extends  the  Lanchester ian  one  by 
retiring  that  dost  rue  :  ior.  crust  be  preceded  by  detection. 

Let  the  iuo  forces  engaged  In  cortbai  be  composed  initially  of  u 
. :  e  on  nr.  c  side  and  v  an  the  other.  Let  it  be  assumed  that  any  unit  not 
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in  contact  with  hostile  ones  must  first  detect  a  hostile  unit  and  will  then 
attempt  to  kill  it.  By  "detect"  we  mean  not  only  perceive  the  presence  of, 
but  identify  and  localize  sufficiently  for  attack. 

What  are  the  possible  states  of  such  a  system? 

Evidently  each  individual  unit  on  one  side  can  be  either  dead  or 

def<?rmi«hv|  tJvactamw*  °\ 

alive;  in  the  latter  case,  his  state — in  the  Markovian  sense,  of  what  may 

\ 

happen  to  him — depends  on  the  set  A  of  hostile  units  he  is  detecting  and  the 
set  B  of  hostile  units  that  have  detected  him.  But  of  the  set  A,  some  may 
be  detected  by  the  unit's  friends;  and  similarly  for  B.  The  outcome  of  the 
combat  may  be  supposed  to  depend  also  on  the  states  of  the  friendly  units  in 
contact  with  A  and  B.  Clearly,  the  full  set  of  relationships  is  not  simple, 
even  to  formulate.  Let  us  give  an  indication  of  the  possible  number  of  states 
that  may  come  into  play. 

At  any  time,  let  there  be  m  and  n  units  alive  on  the  two  sides. 

Indicate  the  units  by  m  dots  on  the  right,  n  on  the  left.  Indicate  that  a 
right-hand  unit  has  detected  a  left  hand  by  drawing  a  blue  line  connecting 
the  corresponding  dots;  and  join  with  a  red  line  two  opposing  dots  to  show 
that  the  one  on  the  left  has  detected  one  on  the  right.  The  resulting  colored 
graph  determines  the  state  of  our  system.  How  many  different  graphs  are 
possible?  Of  the  mn  possible  ways  of  drawing  the  blue  lines,  any  one  can 
actually  be  drawn  or  not.  Hence,  there  are  2mn  possibilities  for  the  blue 
lines;  and  similarly  for  the  red.  Consequently,  there  arc  2/nn  possible 
colored  graphs.  If  thore  wore  a  •  5  ar.d  n  •  4,  and  if  the  units  were  ail 
individually  different  in  their  characteristics,  a  realistic  account  might 
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have  to  consider  2  ,  or  over  10  different  states,  with  over  10  elements 

in  the  transition  matrix  ^nore  molecules  than  in  a  liter  of  gas^. 

The  number  is  considerably  reduced  when  all  units  on  each  side  are 
identical.  To  estimate  the  number  of  states,  we  note  that  any  permutation  of 
the  right-hand  dots  followed  by  a  permutation  (in  general,  different)  of  the 
left-hand  dots  takes  a  colored  graph  into  a  colored  graph,  either  identical 
with  the  original  one,  or  else  different,  but  of  the  same  type  (not  only 
topologically,  but  having  the  same  probabilities  of  transitions).  Let  there 
be  a  totality  of  k  different  types  of  graph,  and,  after  giving  each  type  a 
subscript  in  an  arbitrary  way,  let  there  by  different  graphs  of  the  i'th 
type.  Since  there  are  in  all  m!  n!  double  permutations,  evidently  Nkl  ml  nl  . 

On  the  other  hand,  the  sum  of  for  i  =  1 . k  is  the  quantity  22mn 

encountered  before.  Putting  these  facts  together,  we  obtain 

k  >  22mn/rnl  n! 

a  quantity  well  over  the  hundred  millions  in  the  relatively  simple  case  of 
m  =  5,  n  =  4.  Evidently,  it  would  be  useless  to  await  the  advent  of  larger 
and  faster  computers  into  which  these  states — and  their  transition  matrix — 
can  be  programmed. 

Let  us  see  if  certain  aspects  of  the  detection-destruction  engage¬ 
ment  can  be  isolated  from  the  welter  of  possible  interactions  suggested  fbove- 
just  ab  hydrodynamic  relations  can  be  isolated  from  the  unthinkable  complexiti 
of  tnc  molecular  motions  in  a  fluid. 

Let  us  Imagine  five  boxes  on  the  left  and  five  on  the  right  (Fig.  1) . 
All  tha  units  on  the  left  side  are  represented  as  particles  in  one  of  the  five 
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boxes  on  the  left,  according  to  their  live-dead,  detecting-nondetecting , 
detec ted-nonde tec  ted  status,  as  indicated.  Similarly  with  those  on  the 
right.  If  the  total  number  of  units,  dead  or  alive,  on  the  left  is  u,  and 
on  the  right  is  v,  the  total  number  of  ways  is  the  number  of  partitions 
of  the  positive  integer  u  into  five  parts  (the  number  of  ways  that  five 
people  can  be  paid  with  u  indistinguishable  coins),  times (almost) the  cor¬ 
responding  number  Dy  It  is  known  that  ■  C^+r  C^e  binomial  coefficient 
Hence,  the  number  of  ways  the  boxes  of  Fig.  1  can  be  filled  is  almost — but 


not  quite — 


„u+4  „v+4  (u+1)  (u+2)  (u+3)  (u+4)  (v+1)  (v+2)  (v+3)  (v+4)  , 


An  easy  way  to  show  this  Is  to  write  the  geometric  series  1/(1  — 14>  •  l*t  +t|+ 
Taxe  the  product  over  i  ■  2,  2,...,  u.  On  the  right  we  have  terns  of 
degree  r,  yielding  the  tern  when  every  t ,  la  replaced  by  t.  3ut  th.s 

substitution  replacj8_jh^  product  on  the  lefcoy  (1— c)  u,  whose  binomial 
expansion  yields  C  t  as  the  tern  of  degree  r. 
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Whan  u  =  5,  v  =  4,  this  number  becomes  nearly  (126)  (70)  =  8,820,  an  un- 

2  7 

comfortably  large  number  with  a  (8,820)  >  10  element  transition  matrix;  but 
btill  incredibly  less  than  in  the  earlier  case. 

Two  points  must  be  considered:  First ,  is  the  reuuction  from  the 
former  case  to  the  present  one  acceptably  realistic,  or  is  something  es¬ 
sential  lost  in  the  passage,  so  that  fatal  misconceptions  will  result  from 
the  simplification?  Second ,  granted  that  the  description  embodied  in  Fig.  i 
is  acceptably  realistic,  how  car  we  manage  to  handle  even  this  relative 
simplification? 

l'he  answer  to  the  first  question  will  not  be  given  here.  It  will 
depend  on  the  situation  studied  and  the  purpose  of  its  study.  nut  we  insist 
on  the  fact  that  whenever  a  war  game  is  programmed  on  a  computer,  an  ai- 
firmative  answer  in  this  type  of  question  is  implied  logically — even  though 
only  unconsciously. 

We  shall  deal  with  the  second  question.  Fig.  1  not  only  shows  the 
boxes  of  individual  states,  but,  by  connecting  arrows,  the  possible  transit  lot 
as  well.  These  are  based  on  the  fact  that  a  unit  has  a  chance  ol  belli; 
killed  if  and  only  if  it  has  been  detected. 

Lei  us  think  o:  the  units  In  each  box  as  surged  into  .t  .sort  o:  :  u. 
flowing  as  a  fluid  through  the  connecting  lines  (pipes)  in  the  direction  .f 
the  arrows.  «o  saint  establish  a  rate  of  flow  through  each  pipe. 

This  brings  us  to  the  uecbunl  s.ii.  whereby  detections  and  1....%  as  i-  j>  u*,-. 
«e  shall  aft  n-aJre- - as  deocr  I  pi  1  ec  of  many,  bol  not  all,  cases  that  il  tJs. 
num-feef  of  undetected  unit  a  on  one  side  Is  dlPuLlcut.  the  detection  ptahahl  . j 
of  each  unit  la  J-.alVct},  so  that  the  total  cApcCteJ  tiaallA-er  detected  r.  t  <r 
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next  shore  period  AC  is  left  unchanged.  We  shall  also  assume  that  this  total 

expected  number  is  proportional  to  the  number  of  enemy  units  that  are  alive 

but  have  not  detected  any  unit  (whether  or  not  they  are  themselves  detected) . 

This  assumption — quite  different  from  those  made  in  chemical  kinetics — 

reflects  the  character  of  the  act  of  detection  in  the  present  battle:  it 

involves  localization  and  approach,  and  so  occupies  the  unit  xcith  a  single 

enemy  unit  to  the  exclusion  of  all  others.  Accordingly,  the  flow.box  1  to 

box  2jShall  be  regarded  as  proportional  to  v^  +  v^;  i.e.,  as  equal  to 

b,  (v.  +  v0)  .  The  constant  of  proportionality  b  is  a  figure  of  effectiveness 
113  1 

of  detection  per  unit  on  the  right  (b  will  denote  effectiveness  coefficients 
of  the  right;  3.,  for  the  left). 

Concerning  the  kill  rates,  one  might  consider  the  I.nnchesLer inn  as¬ 
sumption  that  the  expected  number  of  left-hand  units  killed  is  proport  it.  s', 
to  the  number  of  right-hand  units  that  have  detected  them.  For  two  reasons, 
such  an  assumption  cannot  he  applied  to  the  p  lent  situation.  The  first 
reason  1g  Cue  practical  one  that,  within  the  framework  oi  Fig.  1,  uc  do  not 

know  how  many  of  the  v  +  v,  detecting  units  on  the  right  arc  detecting  ‘  i.c 
■ .  1  *  *  •« 

v,  units  In  box  2  on  the  left  and  how  nanv ,  the  u  in  ho*.  •* .  "»u  trv  so 

2  '  *■ 

specify  this  would  lead  us  hack  to  the  earlier  case,  the  i !  ?!  S<e  oi 

which  Wan  live  object  of  the  ini  teiuc  5  ion  of  the  disgfa.iv  of  }'lg.  1. 

second  reason  realties  in  the  concession  of  the  present  tyye  of  engageuver  1  . 

where,  if  detect  ion  is  Caffle-4  Out  on  an  Individual  basis,  so  la  a  i-4«  =  ^esat 

hill.  All  this,  of  course.  Is  for  an  elementary  time  Interval  At,  s»  ahi*r; 

that  only  rsc  thing  has  any  1  livel  IJufi^iid  of  haj'^en l ng .  ,  Vo  shall  as- sums 

•  A  a  when  u-a  frion>lly  uni  l »  never  cnjja&e  the  sane  e?»e:sy  unit, 
fssrinf.  xustual  Uan/jor  of  our,  vsspon#  —  sr.d  no  int  ercnnaunl  «»■»*•  •»  . 
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that  each  detected  unit  on  the  left  has  a  chance  of  being  killed  which 

is  independent  of  the  possible  number  of  additional  units  on  the  right. 

Thus  the  expected  number  out  of  n  detected  units  that  are  killed  during 

At  is  b  nAt,  to  quantities  of  higher  order  in  At.  Accordingly,  the  flow 
n 

rates  along  the  pipes  from  boxes  3  and  4  into  0  on  the  left  are  b2u^  and 
b^u^  ,  respectively. 

The  rates  of  flow  which  reflect  the  conceptions  just  set  forth  are 
given  diagrammatically  in  Fig.  2,  which  assumes  that  no  unit  playing  an 
essential  part  is  absent.  It  is  given  for  the  left-hand  side  of  Fig.  1. 
That  for  the  right-hand  side  is  the  same  with  every  u  and  interchanged 
and  every  a  and  b  interchanged,  oubucrlpta  regaining  unchanged. 

I 


O 

«*.,  f*  ♦  4  w,  J*  #  «  •*,•■***  *  i,  *,  «  •% 

1  «  V*  ,  W*  ,  t  *♦  JL  - 


There  are  tour  more  equations  obtained  from  the  above  by  the  interchange  01 
u  and  v  ,  a  and  b. 

Thus,  our  deterministic  flow  replacement  of  the  stochastic  process 
leads  to  a  homogeneous  linear  system  of  the  eighth  order,  with  constant  co¬ 
efficient.  It  can  be  solved  explicitly  in  terms  of  exponentials,  and  the 
evolution  of  the  combat  completely  dominated. 

This  is  the  deterministic  or  flow  treatment  of  the  detection-destruction 
process  in  simplified  form.  A  stochastic  treatment  could  be  given,  intro¬ 
ducing  the  function 

(9.2)  f(t;  ux,  u2,  u3,  u^;  v^  v,,,  v3,  v^) 


which  is  the  probability  that  at  the  epoch  t  the  state  of  the  system  be  as 
indicated  by  the  (u,  v)  letters.  It  is  easy  but  lengthy  to  write  its  stochastic 
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1 1 : ;  i  ai  i  o->!  i :  !  oioiuc  equal  ion  similar  to  (9.2),  etc.,  and  lo  derive  the 
li.e  equations  ot  the  char.tc  ter  i  s  i  ics  of  the  approximating  partial 
dill  erent  i .« 1  equation. 

It  is  emphasized  that  all  the  present  deductions  from  Fig.  2,  in 
particular,  equations  (9.1),  are  only  valid  in  the  region  in  the  eight-di¬ 
mensional  space  of  t he  positive  variables  (u,  v)  for  which  the  inequalities 
of  rig.  2  hold. 

10.  A  DKTliCTIQN-DKSTKUCTION  DUEL 

The  detection-destruction  engagement  just  examined  becomes  simple 
enough  to  solve  analytically  without  approximation  in  the  case  in  which  it 
reduces  to  a  duel :  only  one  unit  on  each  side.  Then  the  set  of  states  is 
representable  by  the  diagram  of  Fig.  3,  in  which,  if  we  call  the  the  two  op¬ 
ponents  the  "left"  and  "right"  units  (people,  aircraft,  naval  craft,  etc.), 
we  have  numbered  the  states  as  follows: 

State  1,  neither  unit  detecting  the  other; 

State  2,  left  detecting  right,  right  not  detecting  left; 

State  3,  left  not  detecting  right,  right  detecting  left; 

State  A,  each  detecting  the  other; 

State  5,  left  dead,  right  alive; 

State  6,  left  alive,  right  dead. 

Since  pairs  of  transitions  have  a  probability  of  higher  order  than  At  of  oc¬ 
curring  during  this  interval,  the  stochastic  equations  will  give  a  zero  rate 
of  change  the  probability  that  both  be  dead.  Therefore,  this  state  cannot 
be  entered  in  the  present  model  (it  can  be,  in  many  other  models).  Consequently, 


>» 


ii  is  emitted  here.  «c  arc  denoting  the  transit  lost  r.Uco  cifuaa ing  the  ic!i 
combat tant ' ft  effectiveness  by  a,  those  of  like  right  by  b.  Thus,  a  ,  a,,  a 
are  the  rates  of  detection,  kill  In  states  2  and  4,  by  left  against  right,  etc. 


This  schema  of  relations  is  equivalent  to 
matrix,  B  of  §5,  appearing  in  (5.9)'. 


the  following  transition  rate 
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We  now  apply  (5.9)'  to  this  case,  writing  for  brevity  a(x°,  0;  x,  t)  - 
P  (t)  (the  probability  that  at  t>0  the  system  be  in  the  state  x,  having  been 

X 

in  x°  at  t-0) ,  and  denote  the  time  derivative  by  P'(x).  This  leads  to  the 
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These  equations  can  be  solved  explicitly  and  individual ly ,  starting 

with  the  first,  and  working  down  the  list  in  the  order  in  which  they  are 

written.  The  aoot  interesting  ca»  c  l*  that  in  which  the  systea.  is  Inl'iAUy 

in  Stale  1  (both  undetected):  1*^(0)  •  l,  i’,(0)  •  ...  •  P^(0)  •  0.  Then  a# 

tine  increased,  the  first  (our  probabilities,  after  becoming  positive,  later 

approach  zero  exponentially,  whereas  the  last  two  approach  positive  Units 

i’.(-)  and  P,(»)  (adding  up  to  unity),  intcrpretablo  a#  the  probabilities  of 
i  t> 

victory  for  the  right  and  iof  t ,  respectively.  While  these  fora  a  steady  state 
nolution,  their  values  cannot  bo  calculated  by  slnply  replacing  all  the  left- 
hand  sesbers  in  (10.1)  by  ccro--a  coar.only  used  nethod  in  the  study  of 
stochastic  processes. 

Solving  (10.1)  as  Indicated  above,  and  then  letting  l  -»••*,  vc  obtain 
(after  olcaontary  although  perhaps  tedious  reductions) 

blb2  (al+'Vbl+b2)Alblb3 

Pb(m)  "  (a^b^fa^bj)  +  («l+b1)(4J»b3)(al*b2)(A2*bl) 


(10.2) 
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she  n-ost  ohvioua  general  deduction  item-  (10.2),  however,  s«  in  the 
C4»c  oi  none*’  teste  vaiwes  oi  live  cenat  aiti  a  :  that  ?vo  et ay  "V  <>i»i:ui n  ocr.se 
J judgment  wuld  have  been  likely  to  have  drawn  simple  conclusions  iren  the 
del ec t inn-dea l rue t i eft  duel.  Insainuch  as  the  prcacni  one  is  about  as  a.it^lo 
a  realistic  node!  as  one  could  eel  up,  this  conclusion  applies  a  !  of  *.  lor  . 
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result  {  foSfc  the  C<M»pi  iCaled  Quantitative  interplay  oi  eight  Inga,  hills, 
and  their  nutuai  i ofeata 1 1  ihga ,  that  afe  all  in  the  actual  nature  oi  the 
caae--not  an  artiiact  oi  the  technique  i or  ita  investigation. 
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c  HiC  t  Si>ouJ  Can.  oj  <ui„|aca  Jc  applicui  I  Of  afty  initial  vj1.cc,  3ic  e  .  J  c 

i=  a  .  u  3'  •  c  as  (10.7  b"*»t  it!  {cf  ea!  afc  ol>  I  a  incut  .  a  jui  5l'.v.a  ;.\c  jcuat  j{c  cj 

-  i  .  r  n  a '.  jv  ',  ta  1X5',  i;  j’.  ci  . 


j,  vercj  ", -Ve  4c  }  l  V»  !  tea,  "  -'-C  iJcjcj!  iua  o !  S3.c  pf  uti-at*  i  1  i  t  J  c  s  c  J  u 
a—~.  -•>c'v  \Kc-f  afc  <  3van.£c4  3>  ,i  C3.  3.n£  isv£  U<(((a  Of  c^iiijuil.cn',  J-.as  to  i*c 
■"  -  iwally  stubs  *  t  *  w*  in£  t -' *  :--~ll4tcye  Into  live  equations  anC  (  altv.a!  t 


-  *  •  -■  •  •  -  r.  < 

a;  a  VC  J  c-,4 


•  »  •  *  *  ••  i. 

<  ■■  ,►»  «.  •«-  »*  «  > 

we  Icjvfe  see!)  that,  one  c  the  cjjecta  oj  human  ufipf  l<  l  ait  1  1  i  t  y  JaaVc 
cen  se-f  c^ateui,  cVef)'  C<i>U.bal  il<U*4ci,  }to»tc  C»f  io  S  liliW  *  a  5  1  of*,  or  }  f  t>£  f  a  »  ,  !  *  a 
at  its  cofc  a  ai.tt.ple  atfWCtWfc  oJ  4  wniVefaai  type!  4  »)atett.  a»i  its 
states,  a-vi  4  1  *v  oj  U48»l5loaa  (dd  ef  n.4ni  at  Ic  o;  probaai 1  is;  ic  >  govern  ..fc 
She  c&angc  oj  dates  in  the  evolution  ©j  the  system.  vUh  tlai-e.  This  la  the 
ha  a  if  & :  .#£  ha » t  i  c  pfc-ceae  oj  the  i>.tt>4c«  .  Me  have  Seen  further  that  it  has 
4 i va ya  in  fact  been  a  practical  necessity  so  to  conduct  the  analysis  or  the 
cemputat  Iona*  tt.anipv  iat  Iona  that  the  statistical  <;uantiile»  desired  for  a 
decision  4fe  obtained  by  an  iterative  step-by-step  build-up  from.  the  air-pier 
t  fans  it  ion  proh-abi  1  i  t  iea  or  rates:  the  stochastic  process  is  treated  as  ij 
it  vefe  KafVovi an.  Logic  docs  not  exclude  the  contrary  assumption;  hut  this 
would  involve  tt.aclng  every  elementary  transition  depend  on  a  good  part  o',  the 
past  history  <  the  a  y  a  t  ct,  ,  thus  esmpi  {cat  ing  the  situation  beyond  icaalMlit 
m«  have  seen  that  the  Harkov  process  oj  the  combat  model  is  dominated 


by  the  stochastic  equations,  which  express  implicitly  the  way  in  which  the 


■4.  > 

.  .  »  i  :-i  t  ..  - ...  £  <*  5  t5cc5  =  5,>a;  or*  5  x  i  1  I  <  a  4*5  Vc  ap*u5i  aisle. it.*  ale  liclc}  ni  .c% 

.  .  4  1  i*!  .;  ,  wv.  1  k  i ;  c.  *  j>  3  c  a  a  1  Iwciii.a  r  .  V  c  a  5  ;;  ;  c  3  H.a  u  J  1  c  c  L  ciii.j  r.  1  sir 

.  .  -.  .  i  ■■  «< :  tales.  <5r-a.iT.  vc  J-avc  accr.  I'.O’v  !  He  i  t  soli.'..  a  1  c  taJJJeui 

i  t»  r  a  v  *  t  l e  !  t  o  £  ar.a  5  T 1  5  <  a  .  u{  c  Oi!'.  Jt«u lit!  ti.a  .  .'■• .  t  it.  :  o>i  ;  ,  «5*.<  e 

Jala  ate  ,  sjovidcui  that  llac  a  1  o»4  i.a  a  1  i  C  oivail  5  or.;  .ay.  ^  r 

%■  .  '.  -,  c  r,  <1  u'vct. . 

1>V  avc  accti  that  Hue  .altcj  JtBYisO,  V5iiCr,  is  3Vo  1  S  <. ..  I  r  •.  5;-.  t  .a:;  . 

"  a.-  c -.  o£  a  J»  J*  .  ,  e  4  tl.a  1  i.c-.ti.a  lie-  ;iar  2ve  the  Cc3;l5a*  a  1  vail-li  *  5  i-£  . 

'.»t  uii  i  :  even  a' let  accept  l!l,g  considerable  6  trip  i  l £  5 c  at  5  u-f.a  ;ta 

•  <  .  :■—  1  5  the  number  o !  items  t  o  tie  written  deevn  Of  pf  c£ra.!it!l>ed  5  m  a 

...a  >  .  ciifci  the  Jiuubcr  >’!  aoieCaUa  it!  a  liter  oj  £stt  under  a  1  a  J  a  t  ’ 

.  .  - .  t  ton; .  ,1.1s  ia  5  t<i  part  because,  cYeii  U  each  uftll  t  t'.vo « Vet  in  1-  c  •.  :  . 

..a  a  aii.a.t  number  o  t  stales  when  viewed  alcnc,  the  number  of  5  ft  1  c ;  -  r  c  -  a  5  .•  » 

Im  ..ecu  tint  act  of  units  may  be  ctwrauuo.  In  pari  ll  la  because  c.ic  1".  unit 

can  it  naif  be  in  a  complex  sol  oi  states.  Thus,  l {  a  naval  craft  has  10 

trad.  an  enemy  unit  during  an  appreciable  interval  of  tine,  its  phase ,  or 

t he  age  of  its  tracking  situation,  is  r«t;uirct!  In  order  to  tpcolfy  its  state 

In  the  markov  process.  Tills  is  a  continuous  parameter,  which,  when  replaced 

by  a  finite  sot  of  intervals  in  a  computational  approximation,  would  load  to 

a  considerable  Increase  in  the  number  of  states  for  that  unit.  Even  if  there 

were  no  Complex  of  interconnect  ions  of  many  systems,  the  fact  that  a  system 

c o— ported  o,  n  ii . .  —  ilar  units  each  having  n  possible  states  would  be  a  system 

2  n 

having  about  s'  possible  states,  and  a  transition  matrix  of  s  elements, 
shows  how  easily  the  set  of  terms  or  numerical  items  can  grow  out  of  control. 


■vs-®  AS.  t  *»ftl  l  ft  V4  •  £<sj  t,  x.'Z.i  j.jc  oj  *1'b>w«  *cS,  J^rCeS?  c®:  i  •)  Vc 

-*  -  * 

li«»  •  l  l  J  •  i  «<ft  "V  7  «  VC1*'!  1  C ,  *.u  li.e  aSs'veJ  SsD>4«*  V»e  affect*..;  >7  *  fO-klJj 

ttf  *,  '.lUss  ®v<!H  A  ihi  1  J  5y  VC  f  c  c'f  4  Ivftoft  (  «5uc  Afcs'V*}  i-o  i  Vs 

4ppl  i  *••<«.  4«V  J  l?  {<  4 1  it. 

We  !4V«  seer,  ift  sect  lerJ.a  ft  ataft  V  h<?V  to  f  c^Ufe  4  «*«'ftcl  of  4  M:*.t.* 

uni!  a<  *.  ion  by  snot  be  1  «-omJc  1 ,  intended  to  give  only  the  <wiut  s : 

ever.;®  4«  4  s»4?h  having  4  d.mH  number  of  branches,  forming  4  I  low  dl*s:a.Ti. 
that  c4n  be  Analysed  numcr  leal  ly.  Of  course  this  elves  up  the  a  tufty  of 
detailed  interact  Ions;  but  it  may  retain  considerable  realism,  as  when  each 
of  the  opposing  forces  remains  together  and  the  interactions  involve  chiefly 
detection  and  approach  of  the  two  forces.  When  after  such  preliminary 
operations,  the  actual  combat  taken  ; lace  between  pairs  of  individuals  (the 
duel),  or  in  very  small  groups,  the  sore  detailed  study  of  such  actions  can 
often  be  maco  using  the  stochastic  equations,  as  in  410.  Such  operations 
have  been  called  endgames  by  G.  Kalsbcck,  in  analogy  to  the  closing  stages 
in  chess;  although  after  the  nilltary  duels,  surviving  units  cay  reenter 
the  larger  gaae. 

For  the  cost  part,  the  effects  of  the  proposed  weapon  systeas  or 


tactics  undar  study  are  revealed  by  the  ondgano.  But  oosa  cay  already  be 


see  ;  he  .iliCi  SUU4  i  l  e>v  ti  zpi- .  i'~  l&  *11  t*ies,  J3ata  £(«-S!t|  i  1  Ci  S* 

n.civt  „  a  ia.  halfi*,!  ".  u  act  Jv  a  {  2a*  {  ciiif.  *tl.e  a  •  -  *i.d  £  uiaa  a  >  ,  Vi.*{ 

;  a  .  .  i  i  .  b3  vc  *;.v».i  j  *£  ",  -u  t  a  ■  "d  u  i»J  io  2a0.{  jticas*.{  {  hctn.ac  Itc  e  ,  *ia2  ii.  v2a*{ 
jjjjuj'ini  uj  uses,  C  *,  'a.  !!it)e'u}c,  *  fcvl-lc  !  o  )c,c4Ui‘it  i  *.  vw  l  4  .  J*f 

c)j,  n^, t,  cat  lave  5»*t  l-4{£--£  ».*  *  a  ire  j»{d'v&  o*  Jaavel  via  H  a  Joi  *,  he  j>>„ij-o,ac  of  fa.Hi- 

li  a  £>£  a  1  >.c  f  a  ,  iuo-  {  aaa  a  a  *•  C  a  {  i  vC  .  -¥  *  <c  a  v*o*v «  4  la  l tac  #  J  c>c  S  ;•*'  c  a  caa>i  £  *11- c  a 

;*-rvivtfe..|  4lJc4{  <*ia;*c:  o{  {he  vislja,  ivi  iaiiwac  av(J.  cSi4-£*ll.ca  vts*l4  iaoi 
o-,  .a(i  l*.ej  v'i5n»i4  feet  { e{U5s.*{«  *fcy  hf*iv<2s  a!  i!.c  J  l<i’v  £{*J>h  i  t* .  1  «»*«■■;  «  l '.  >. 

*  •  »  Ajjif  «!t  t*v;«  Jaf  .  t  {  >• .  tvei*.  vlveft  *  <oa?  Jy  til-?}  ttVem.eat  has  »'hvf, 

•  J.  a  a  ..a  i*£  c  v  i  ©*4  4  vf  5  ciai  a  .  a  a  .  {  £2*5  ,  1 5v  1  a  2*S  a  *  e  he  €£$«  cf  Cat  liato  «  sac  4  *  *  *  .  " 

*iiji  <  a  a  { -c  J  i  c  C  {  i  vciaca  a  ICSVcaJ  i£*{  l«». 

c  orc  iu»  ica,  ve  fl.ay  say  !la*S  She  Se-glcel  ^ARSSiaUVe  alvCy  oj 
cwinh**.  *c  ;  ler.a  la  <»  iae-ccoo-af  y  cti-ad  l  {  len  f  *>f  *r.y  {«4*U5S<  etwiy  o{  »  l  t*a  / 
C^a  { -a  ii  ec  1 1  vcfvcaa  .  Oi  <«M«f*e  .1  Ja  iU>l  a  awl  *  1C  i  ent  COR»l  1 1  left :  dC-OSUiMllC 

i at  tote  iar  beyond  (h«  present  Invest fallen  Jimat  Intervene. 
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